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Preface 



OBJECTIVES 

Recent years have witnessed a thriving research activity on cooperative con- 
trol and motion coordination. This interest is motivated by the growing 
possibilities enabled by robotic networks in the monitoring of natural phe- 
nomena and the enhancement of human capabilities in hazardous and un- 
known environments. 

Our first objective in this book is to present a coherent introduction to 
basic distributed algorithms for robotic networks. This emerging discipline 
sits at the intersection of different areas such as distributed algorithms, par- 
allel processing, control, and estimation. Our second objective is to provide 
a self-contained, broad exposition of the notions and tools from these areas 
that are relevant in cooperative control problems. These concepts include 
graph-theoretic notions (connectivity, adjacency, and Laplacian matrices), 
distributed algorithms from computer science (leader election, basic tree 
computations) and from parallel processing (averaging algorithms, conver- 
gence rates), and geometric models and optimization (Voronoi partitions, 
proximity graphs). Our third objective is to put forth a model for robotic 
networks that helps to rigorously formalize coordination algorithms running 
on them. We illustrate how computational geometry plays an important role 
in modeling the interconnection topology of robotic networks. We draw on 
classical notions from distributed algorithms to provide complexity measures 
that characterize the execution of coordination algorithms. Such measures 
allow us to quantify the algorithm performance and implementation costs. 
Our fourth and last objective is to present various algorithms for coordina- 
tion tasks such as connectivity maintenance, rendezvous, and deployment. 
We especially emphasize the analysis of the correctness and of the complex- 
ity of the proposed algorithms. The technical treatment combines control- 
theoretic tools such as Lyapunov functions and invariance principles with 
techniques from computer science and parallel processing, such as induction 
and message counting. 
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THE INTENDED AUDIENCE 

The intended audience for this book consists of first- and second-year grad- 
uate students in control and robotics from Computer Science, Electrical 
Engineering, Mechanical Engineering, and Aerospace Engineering. A famil- 
iarity with basic concepts from analysis, linear algebra, dynamical systems, 
and control theory is assumed. The writing style is mathematical: we have 
aimed at being precise in the introduction of the notions, the statement of 
the results, and the formal description of the algorithms. This mathematical 
style is complemented by numerous examples, exercises, intuitive explana- 
tions and motivating discussions for the introduction of novel concepts. 

Researchers in the fields of control theory and robotics who are not aware 
of the literature on distributed algorithms will also benefit from the book. 
The book uses notions with a clear computer-science flavor such as syn- 
chronous networks, complexity measures, basic tree computations, and lin- 
ear distributed iterations, and integrates them into the study of robotic 
networks. Likewise, researchers in the fields of distributed algorithms and 
automata theory who are not aware of robotic networks and distributed con- 
trol will also find the book useful. The numerous connections that can be 
drawn between the classical study of distributed algorithms and the present 
book provide a friendly roadmap with which to step into the field of con- 
trolled coordination of robotic networks. 

AN OUTLINE OF THE BOOK 

Chapter 1 presents a broad introduction to distributed algorithms on syn- 
chronous networks. We start by presenting basic matrix notions and a 
primer on graph theory that gives special emphasis to linear algebraic as- 
pects such as adjacency and Laplacian matrices. After this, we introduce 
the notion of synchronous networks, and we present time, communication, 
and space complexity notions. We examine these notions in basic algorithms 
such as broadcast, tree computation, and leader election. The chapter ends 
with a thorough treatment of linear iterations and averaging algorithms. 

Chapter 2 presents basic geometric notions that are relevant in motion co- 
ordination. Robotic networks have a spatial component which is not always 
present in synchronous networks as studied in computer science. Geometric 
objects such as polytopes, Voronoi partitions, and geometric centers play 
an important role in modeling the interaction of robotic networks with the 
physical environment. Proximity graphs allow us to rigorously formalize the 
interconnection topology of a network of robotic agents, and characterize 
the spatially distributed character of coordination algorithms. This notion 
is a natural translation of the notion of distributed algorithms treated in 
the previous chapter. The chapter concludes with a detailed discussion on 
concepts from geometric optimization and multicenter functions. 
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Chapter 3 introduces a model for a group of robots that synchronously 
communicate/sense locally, process information, and move. We describe 
the physical components of the robotic network and we introduce a formal 
notion of a motion coordination algorithm as a control and communication 
law. Generalizing the notions introduced in Chapter 1, we introduce the 
notions of task and of time, communication, and space complexity. We 
illustrate these concepts by means of a simple and insightful example of a 
group of robots moving on a circle. 

Chapter 4 analyzes in detail two coordination tasks: connectivity main- 
tenance and rendezvous. The objective of "connectivity maintenance" is to 
establish local rules that allow agents to move without losing the connec- 
tivity of the overall networks. The objective of "rendezvous" is to establish 
local rules that allow agents to agree on a common spatial location. We 
present coordination algorithms that achieve these tasks, making use of the 
geometric concepts introduced in the previous chapters. Furthermore, we 
provide results on the correctness and complexity of these algorithms. 

Chapter 5 considers deployment problems. The objective of "deployment" 
is to establish local rules that allow agents to achieve optimal network config- 
urations in an environment of interest. Here, optimality is defined using the 
multicenter functions from geometric optimization introduced in Chapter 2. 
We present coordination algorithms that achieve these tasks, characterizing 
their correctness and complexity. 

Chapter 6 has a dual purpose. First, we introduce an event-driven control 
and communication law, in which computation and communication actions 
are triggered by asynchronous events, rather than taking place on a periodic 
schedule. Second, we consider a boundary tracking problem, and propose 
an "estimation and balancing" algorithm that allows a robotic network to 
monitor a moving boundary efficiently. 

The reader will note that, as the discussion progresses, the selection of 
topics emphasizes problems in which we have been directly involved. There 
are exciting topics that have been considered in the literature and are not 
presented here in depth, albeit we briefly discuss a number of them through- 
out the exposition. In this, our first effort, we decided to tackle the problems 
that we knew better, postponing the rest for the future. We hope the reader 
will appreciate the result and share, while reading it, some of the fun we 
had in writing it. 

HOW TO USE THIS BOOK AS A TEXT 

Our experience and opinion is that this text can be used for a quarter- or 
semester-long course on "Distributed Control" or on "Robotic Networks." 
Such a course could be taught in an Engineering or a Computer Science 
department. We taught such a course at our respective institutions over a 
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10 weeks, 3 hours a week, period, skipping some material and some proofs 
(e.g., skipping some algebraic graph theory in Chapter 1, some of the multi- 
center functions and the nonconvex geometry treatment in Chapter 2, and 
the relative-sensing model in Chapter 3). With proofs and more complete 
treatment, we estimate that the material might require 45 hours of lecture 
time. 

Finally, the complete latest version of the manuscript with supplementary 
material, such as slides and software, is freely available on the internet at: 

http : //coordinationbook . info 

At this website, we plan to maintain an up-to-date electronic version of the 
manuscript that incorporates corrections and minor improvements. 
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Chapter One 

An introduction to distributed algorithms 



Graph theory, distributed algorithms, and linear distributed algorithms are 
a fascinating scientific subject. In this chapter we provide a broad introduc- 
tion to distributed algorithms by reviewing some preliminary graphical con- 
cepts and by studying some simple algorithms. We begin the chapter with 
one section introducing some basic notation and another section stating a 
few useful facts from matrix theory, dynamical systems, and convergence 
theorems based on invariance principles. In the third section of the chapter, 
we provide a primer on graph theory with a particular emphasis on alge- 
braic aspects, such as the properties of adjacency and Laplacian matrices 
associated to a weighted digraph. In the next section of the chapter, we in- 
troduce the notion of synchronous network and of distributed algorithm. We 
state various complexity notions and study them in simple example prob- 
lems such as the broadcast problem, the tree computation problem, and the 
leader election problem. In the fifth section of the chapter, we discuss linear 
distributed algorithms. We focus on linear algorithms defined by sequences 
of stochastic matrices and review the results on their convergence proper- 
ties. We end the chapter with three sections on, respectively, bibliographical 
notes, proofs of the results presented in the chapter, and exercises. 

1.1 ELEMENTARY CONCEPTS AND NOTATION 
1.1.1 Sets and maps 

We assume that the reader is familiar with basic notions from topology, 
such as the notions of open, closed, bounded, and compact sets. In this 
section, we just introduce some basic notation. We let x £ S denote a point 
x belonging to a set S. If S is finite, we let |5| denote the number of its 
elements. For a set S, we let P(5) and ¥(S) denote the collection of subsets 
of S and the collection of finite subsets of S, respectively. The empty set 
is denoted by 0. The interior and the boundary of a set S are denoted by 
int(S') and dS, respectively. If R is a subset of or equal to S, then we write 
R C S. If R is a strict subset of S, then we write R C S. We describe 
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subsets of S defined by specific conditions via the notation 

{x £ S | condition(s) on x}. 

Given two sets Si and S2, we let S1US2, SiDS^, and S\ x S2 denote 
the union, intersection, and Cartesian product of Si and S2, respectively. 
Given a collection of sets {S a } a eA indexed by a set A, we interchangeably 
denote their Cartesian product by IlaeA ^a or by IK^a I a £ A}. We 
adopt analogous notations for union and intersection. We denote by S n the 
Cartesian product of n copies of the same S. The diagonal set diag(S n ) of 
S n is given by diag(S n ) = {(s, . . . , s) £ S n \ s £ S}. The set Si \ S2 contains 
all points in Si that do not belong to S2. 

We let N and Z>o denote the set of natural numbers and of non-negative 
integers, respectively. We let R, R>o, R>o> and C denote the set of real 
numbers, strictly positive real numbers, non-negative real numbers, and 
complex numbers, respectively. The sets R d , C d , and §> d C R rf+1 are the 
d-dimensional Euclidean space, the d-dimensional complex space, and the 
d-dimensional sphere, respectively. The tangent space of R , denoted by 
TR d , is the set of all vectors tangent to R d . Note that TR d can be identified 
with R xR by mapping a vector v tangent to R at x £ R to the pair (x, v). 
Likewise, T§ is the set of all vectors tangent to § , and can be identified with 
§ d x R d . The Euclidean space R d contains the vectors 0<j = (0, . . . , 0), Id = 
(i, . . . , f), and the standard basis ei = (1,0, . . . ,0), . . . , ea = (0, . . . , 0, 1). 
Given a < b, we let [a, b] and ]a, b[ denote the closed interval and the open 
interval between a and b, respectively. 

Given two sets S and T, we let / : S — > T denote a map from S to T, 
that is, a unique way of associating an element of T to an element of S. 
The image of the map / : S — > T is the set image (/) = {/(s) £ T \ s £ S}. 
Given the map / : S — > T and a set Si C S, we let /(Si) = {f(s) \ s £ Si} 
denote the image of the set Si under the map /. Given / : S — > T and 
g : J7 — > S, we let / o g : U — > T, defined by f o g (u) = f(g(u)), denote 
the composition of / and 5. The map ids : S — > S is the identity map on 
S. Given / : S — > R, the support of / is the set of elements s such that 
f(s) 7^ 0. Given a subset R C S, the indicator map 1# : S — > R associated 
with i? is given by lfl(g) = 1 if q £ -R, and 1_r((?) = if q i?. Given 
two sets S and T, a set-valued map, denoted by h : S =4 T, associates to 
an element of S a subset of T. Given a map f : S ^ T, the inverse map 
f~ l : T r4 S is defined by 

r 1 (i) = { S £S|/( S ) = t}. 

If / is a real-valued function, that is, a function of the form / : S — > R, 
then f~ l {x) C S, for any x £ R, is a ZeueZ sei of /. In what follows, 
we require the reader to be familiar with some basic smoothness notions 
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for functions. Specifically, we will use the notions of locally and globally 
Lipschitz functions, differentiable, piecewise differentiable and continuously 
differentiable functions, and functions that are multiple times differentiable. 

Finally, we introduce the so-called Bachmann-Landau symbols. For /, g : 
N — > R>o, we say that / £ 0(g) (resp., / £ $!(<?)) if there exist no £ N and 
K £ R>o (resp., k £ R>o) such that f(n) < Kg(n) for all n > uq (resp., 
f(ri) > kg(n) for all n > no). If / £ 0(g) and / £ £l(g), then we use the 
notation / £ Q(g). 



1.1.2 Distance functions 

A function dist : S x S — > R>o defines a distance on a set S if it satisfies: 
(i) dist(x,y) = if and only if x = y; (ii) dist(x,y) = dist(y,x), for all 
x,y £ S; and (iii) dist(x,y) < dist(x,z) + dist(z,y), for all x,y,z £ S. The 
pair (S, dist) is usually called a metric space. 

Some relevant examples of distance functions include the following: 



L p -distance on R . For p £ [1, +oo[, consider the L p -norm on R defined 
by IMIp = (Si=i l a; i| P ) 1 • ^ or P = +°°) consider the L°°-norm on 
R defined by ||x||cx) = max ie{i,...,d} |^»|- Any of these norms defines 
naturally a L p -distance in R by dist p (x,y) = \\y — x\\ p . In partic- 
ular, the most widely used is the Euclidean distance, corresponding 
to p = 2. Unless otherwise noted, it is always understood that R is 
endowed with this notion of distance. We will also use the L l - and 
the L°°-distances. Finally, it is convenient to define the norm ||.z||c of 
a complex number z £ C to be the Euclidean norm of z regarded as a 
vector in R 2 . 

Geodesic distance on S . Another example is the notion of geodesic dis- 
tance on § . This is defined as follows. For x,y £ S , dist g (x,y) is 
the length of the shortest curve in S connecting x and y. We will 
use this notion of distance in dimensions d = 1 and d = 2. On the 
unit circle S 1 , by convention, let us define positions as angles measured 
counterclockwise from the positive horizontal axis. Then, the geodesic 
distance can be expressed as 

dist g (x,y) = min{dist c (x,y),dist cc (x,y)}, x, y £ S 1 , 

where dist c (x,y) = (x — y) mod 2n is the clockwise distance and 
dist cc (x,y) = (y — x) mod 2tt is the counterclockwise distance. Here 
the clockwise distance between two angles is the path length from an 
angle to the other traveling clockwise, and x mod 2tt is the remainder 
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Figure 1.1 Open balls (dashed lines), a closed ball (solid line), and an open lune for the 
Euclidean distance on the plane. 

of the division of x by 2n. On the sphere § 2 , the geodesic distance can 
be computed as follows. Given x,y £ § 2 , one considers the great circle 
determined by x and y. Then, the geodesic distance between x and y 
is exactly the length of the shortest arc in the great circle connecting 
x and y. 

Cartesian product distance on M. dl x S^ 2 . Consider M. dl endowed with 
an L p -distance, p £ [l,+oo], and S d2 endowed with the geodesic dis- 
tance. Given (xi,yi), (2:2,2/2) £ K^ 1 x§^ 2 , their Cartesian product dis- 
tance is given by dist p (xi,a;2) + dist 9 (yi, 2/2)- Unless otherwise noted, 
it is understood that M dl x S^ 2 is endowed with the Cartesian product 
distance (dist2,dist g ). 

Given a metric space (S, dist), the open and closed balls of center ieS 
and radius e £ IR>o are defined by, respectively, 

B(x,e) = {y £ S | dist(x,y) < e}, 
B(x,e) = {y £ S \ dist(x,y) < e}. 

Consider a point x £ X and a set S C X. A neighborhood of a point 
x £ X is a subset of X that contains an open ball centered at x. A neigh- 
borhood of a set F c X is a subset of X that, for each point y £ Y, 
contains an open ball centered at y. The open lune associated to x, y £ S is 
5(x, dist(x, y)) n 2?(y, dist (a;, y)). These notions are illustrated in Figure 1.1 
for the plane equipped with the Euclidean distance. 

Given a metric space (S, dist), the distance between a point x £ S and a 
set W C S is the infimum of all distances between a; and each of the points 
in W. Formally, we set 

dist(x, W) = inf{dist(x, y) \ y £ W}. 

The projection of a point x £ S onto a set W C 5 is the set-valued map 
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proj^/ : S =t W defined by 

proj H /(x) = {y G W | dist(x,y) = dist(x, W)}. 

If W is a closed set, then projw(x) / for any ieS. The diameter of a 
set is the maximum distance between any two points in the set; formally, we 
set diam(5) = sup{dist(:c, y) \ x,y € S}. With a slight abuse of notation, 
we often use diam(P) to denote diam({pi, . . . ,p n }) for P = (pi, . . . ,p n ). 



1.1.3 Curves 

A curve is the image of a continuous map 7 : [a, b] — > R . The map 7 is called 
a parameterization of the curve. We usually identify a parameterization with 
the curve it defines. Without loss of generality, any curve can be given a 
parametrization with a = and b = 1. A curve connects the two points p 
and q if 7(0) = p and 7(1) = q. A curve 7 : [0, 1] — > R is noi self-intersecting 
if 7 is injective on (0, 1). A curve is closed if 7(0) = 7(1). 

A set S C R d is path connected if any two points in S can be joined by 
a curve. A set S C X is simply connected if it is path connected and any 
not self-intersecting closed curve can be continuously deformed to a point in 
the set; that is, for any injective continuous map 7 : [0, 1] — > S that satisfies 
7(0) = 7(1), there exist p G S and a continuous map H : [0, 1] x [0, 1] — > S 
such that H(t,0) = -f(t) and H(t,l) = p for all t G [0,1]. Informally, a 
simply connected set is a set that consists of a single piece and does not 
have any holes. 

Next, consider a piecewise continuously differentiable curve 7 : [0, 1] — > 
R d ; the length of 7 is 

length(7) = / ||7(s)|| 2 ds, 



and its arc-length parameter is 

•SarcO) = / ||7(t)|| 2 dt. 



'0 

Note that as the parameter t varies in [0, 1], the arc- length parameter s arc (i) 
varies in [0, length^)]. The arc-length parameterization of the curve is the 
map 7 arc : [0, length^)] — > R d defined by the equation 7 ar c(s a rc(s)) = 7(s)- 
With a slight abuse of notation, we will often drop the subindex arc and 
denote the arc-length parameterization by 7 too. 

For closed, not self-intersecting curves in the plane, we introduce the 
notion of signed and absolute curvatures as follows. Let 7 : [0, length^)] — > 
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M 2 be the counterclockwise arc-length parameterization of a curve. Assume 
7 is closed, not self-intersecting and twice continuously differentiable. Define 
the tangent vector 7' : [0, length^)] — > IR 2 by 'j'(s) = -r. Note that the 
tangent vector has unit length, that is, ||7'(s)||2 = 1 f° r a h s - Additionally, 
define the outward normal vector n out : [0, length^)] — > M 2 to be the unit- 
length vector that is point-wise orthogonal to the tangent vector and directed 
outside the set enclosed by the closed curve 7. With these notations, the 
signed curvature K s i gne d : [0, length^)] — > R is defined by requiring that it 
satisfies 

7 "(s) = -K signed (s)n out (s), and n' out (s) = K signed (s)j'(s). 

If the set enclosed by the closed curve 7 is strictly convex, then the signed 
curvature of 7 is strictly positive. In general, the (absolute) curvature K a b s : 
[0, length(7)] — > M>o and the radius of curvature p : [0, length^)] — > M>o of 
the curve 7 are defined by, respectively, 

«abs(s) = |K s ig n ed(s)|, and p(s) = (^signed^)!" 1 - 



1.2 MATRIX THEORY 

Here, we present basic notions and results about matrix theory, following the 
treatments in Horn and Johnson (1985) and Meyer (2001). We let R nxm and 
C nxm denote the set ofnxm real and complex matrices. Given a real matrix 
A and a complex matrix U, we let A T and U* denote the transpose of A 
and the conjugate transpose matrix of U, respectively. We let I n denote the 
n x n identity matrix. For a square matrix A, we write A > 0, resp. A > 0, 
if A is symmetric positive definite, resp. symmetric positive semidefinite. 
For a real matrix A, we let kernel(j4) and rank(A) denote the kernel and 
rank of A, respectively. Given a vector v, we let diag(f) denote the square 
matrix whose diagonal elements are equal to the component v and whose 
off-diagonal elements are zero. 



1.2.1 Matrix sets 

A matrix A £ M nxn with entries aij, i,j £ {1, . . . , n}, is 

(i) Orthogonal if AA T = I n , and is special orthogonal if it is orthogonal 
with det(.A) = +1. The set of orthogonal matrices is a group. 1 



1 A set G with a binary operation, denoted by G X G 9 (a, b) i— > a * b £ G, is a group if: (i) 
a* (b* c) = (a*b) * c for all a, b, c S G (associativity property); (ii) there exists e £ G such that 
a* e = e * a = a for all a £ G (existence of an identity element); and (iii) there exists a -1 £ G 
such that a* a -1 = a -1 * a = e for all a £ G (existence of inverse elenrents). 
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(ii) Nonnegative (resp., positive) if all its entries are nonnegative (resp., 
positive). 

(iii) Row-stochastic (or stochastic for brevity) if it is nonnegative and 



En 



■n 



1, for all i G {!,..., n}; in other words, ^4 is row- 



stochastic if 



Al r 



(iv) Column-stochastic if it is nonnegative and Yll 



=1 "y 



1, for all 



j G {l,...,n}. 

(v) Doubly stochastic if A is row-stochastic and column-stochastic. 

(vi) Normal if A T ,4 = AA T . 

(vii) A permutation matrix if ^4 has precisely one entry equal to one 
in each row, one entry equal to one in each column, and all other 
entries equal to zero. The set of permutation matrices is a group. 

The scalars fi\, . . . , //& are convex combination coefficients if \Xi > 0, for 
i G {1, ...,k}, and Y2i=i Mi = 1- (Each row of a row-stochastic matrix 
contains convex combination coefficients.) A convex combination of vectors 
is a linear combination of the vectors with convex combination coefficients. 
A subset U of a vector space V is convex if the convex combination of any 
two elements of U takes value in U. For example, the set of stochastic 
matrices and the set of doubly stochastic matrices are convex. 

Theorem 1.1 (Birkhoff von Neumann). A square matrix is doubly 
stochastic if and only if it is a convex combination of permutation matri- 
ces. 



Next, we review two families of relevant matrices with useful properties. 
Toeplitz matrices are square matrices with equal entries along each diagonal 
parallel to the main diagonal. In other words, a Toeplitz matrix is a matrix 
of the form 



to 


tl 








t n -2 


t n -l 


t-1 


to 

t-1 


h 

to 

t-1 


tl 

to 

t-1 


h 
to 


h 


tn-2 


t-n+2 








t-1 


to 


h 


t-n+1 


t-n+2 








t-i 


to 
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An n x n Toeplitz matrix is determined by its first row and column, and 
hence by 2n — 1 scalars. 

Circulant matrices are square Toeplitz matrices where each two subse- 
quent row vectors v% and v%+\ have the following two properties: the last 
entry of v% is the first entry of i>i+i and the first (n — 1) entries of v% are the 
second (n — 1) entries of Ui+i- In other words, a circulant matrix is a matrix 
of the form 



co 

C n -1 



CO 

Cn-1 



(-1 

co 

Cn-1 



C\ 
CO 

Cn-1 



C2 
Cl 



Cl 
Co 

Cn-1 



C-2 





"I 


Cn-2 


Cn-1 




Cn-2 


Cl 




CO 


Cl 


Cn-1 


CO . 



and, therefore, it is determined by its first row. 



1.2.2 Eigenvalues, singular values, and induced norms 



We require the reader to be familiar with the notion of eigenvalue and of 
simple eigenvalue, that is, an eigenvalue with algebraic and geometric multi- 
plicity 2 equal to 1. The set of eigenvalues of a matrix A £ R raxn is called its 
spectrum and is denoted by spec (A) c C The singular values of the matrix 
A G R nxn are the positive square roots of the eigenvalues of A T A. 

We begin with a well-known property of the spectrum of a matrix. 

Theorem 1.2 (Gersgorin disks). Let A be an n x n matrix. Then 



spec(A) C [J Ize 
i£{l,...,n} 



\z - auWr. < 



n 

J2 m}- 



j=ij^« 



Next, we review a few facts about normal matrices, their eigenvectors and 
their singular values. 

2 The algebraic multiplicity of an eigenvalue is the multiplicity of the corresponding root of 
the characteristic equation. The geometric multiplicity of an eigenvalue is the number of linearly 
independent eigenvectors corresponding to the eigenvalue. The algebraic multiplicity is greater 
than or equal to the geometric multiplicity. 
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Lemma 1.3 (Normal matrices). For a matrix A £ M nxn , the following 
statements are equivalent: 

(i) A is normal; 

(ii) A has a complete orthonormal set of eigenvectors; and 

(Hi) A is unitarily similar to a diagonal matrix, that is, there exists a 
unitary^ matrix U such that U* AU is diagonal. 

Lemma 1.4 (Singular values of a normal matrix). // a normal matrix 
has eigenvalues {Ai, . . . , A ra }, then its singular values are {\X\\, . . . , |A n |}. 

It is well known that real symmetric matrices are normal, are diagonaliz- 
able by orthogonal matrices, and have real eigenvalues. Additionally, circu- 
lant matrices are normal. 

We conclude by defining the notion of induced norm of a matrix. For 
p £ NU{oo}, the p-induced norm of A £ M. nxn is 

\\A\\ p = max{||Ar|| p | ||a;||p = 1}. 

One can see that 

n n 

'Hj I > 



\A\\i = max > Iom'Ij Halloo = max > Ioj 

J6{l,...,n}^ ie{l,...,n}^ 



| -A || 2 = max{o" | a is a singular value of A}. 



1.2.3 Spectral radius and convergent matrices 

The spectral radius of a matrix A £ M 7ixn is 

p(A) = max{||A|| c | A £ spec(A)}. 

In other words, p(A) is the radius of the smallest disk centered at the origin 
that contains the spectrum of A. 

Lemma 1.5 (Induced norms and spectral radius). For any square 
matrix A and in any norm p £ NU{oo} ; p(A) < \\A\\ P . 

We will often deal with matrices with an eigenvalue equal to 1 and all 
other eigenvalues strictly inside the unit disk. Accordingly, we generalize the 
notion of spectral radius as follows. For a square matrix A with p(A) = 1, 
we define the essential spectral radius 

p ess {A) = max{||A|| c | A £ spec(A) \ {1}}. (1.2.1) 

3 A complex matrix U S C nxn is unitary if U~ l = U* . 

9 
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Next, we will consider matrices with useful convergence properties. 

Definition 1.6 (Convergent and semi-convergent matrices). A ma- 
trix A e K" xn is 

(i) semi- convergent if lini£^ +00 A^ exists; and 

(ii) convergent if it is semi-convergent and lini£^ +00 A e = 0. • 

These two notions are characterized as follows. 

Lemma 1.7 (Convergent and semi-convergent matrices). The square 
matrix A is convergent if and only if p(A) < 1. Furthermore, A is semi- 
convergent if and only if the following three properties hold: 

(i) Pi*) < 1; 

(ii) p ess (A) < 1, that is, 1 is an eigenvalue and 1 is the only eigenvalue 
on the unit circle; and 

(Hi) the eigenvalue 1 is semisimple, that is, it has equal algebraic and 
geometric multiplicity (possibly larger than one). 

In other words, A is semi-convergent if and only if there exists a nonsin- 
gular matrix T such that 



A = T 



h 
B 



T-\ 



where B £ JR( n_fc ) x ( n_fc ) is convergent, that is, p(B) < 1. With this notation, 
we have p ess (A) = p{B) and the algebraic and geometric multiplicity of the 
eigenvalue 1 \s k. 



1.2.4 Perron-Frobenius theory 

Positive and nonnegative matrices have useful spectral properties. In what 
follows, the first theorem amounts to the original Perron's Theorem for posi- 
tive matrices and the following theorems are the extension due to Frobenius 
for certain nonnegative matrices. We refer to (Horn and Johnson, 1985, 
Chapter 8) for a detailed treatment. 

Theorem 1.8 (Perron-Frobenius for positive matrices). If the square 
matrix A is positive, then 

(i) P{A) > 0; 

10 
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(ii) p{A) is an eigenvalue, it is simple, and p{A) is strictly larger than 
the magnitude of any other eigenvalue; and 

(Hi) p{A) has an eigenvector with positive components. 

Requiring the matrix to be strictly positive is a key assumption that limits 
the applicability of this theorem. It turns out that it is possible to obtain 
the same results of the theorem under weaker assumptions. 

Definition 1.9 (Irreducible matrix). A nonnegative matrix A £ R nxn is 
irreducible if, for any nontrivial partition JU K of the index set {1, . . . , n}, 
there exist j £ J and k £ K such that ajk 7^ 0. 

Remark 1.10 (Properties of irreducible matrices). An equivalent def- 
inition of irreducibility is given as follows. A matrix A £ IR raxn is irreducible 
if it is not reducible, and is reducible if either: 

(i) n = 1 and A = 0; or 

(ii) there exists a permutation matrix P £ M nxn and a number r £ 
{1, . . . , n — 1} such that P T AP is block upper triangular with diag- 
onal blocks of dimensions r x r and {n — r) x (n — r). 

It is an immediate consequence that the property of irreducibility depends 
upon only the patterns of zeros and nonzero elements of the matrix. • 

We can now weaken the assumption in Theorem 1.8 and obtain a compa- 
rable, but weaker, result for irreducible matrices. 

Theorem 1.11 (Perron— Frobenius for irreducible matrices). If the 

nonnegative square matrix A is irreducible, then 

(i) p(A) > 0; 

(ii) p(A) is an eigenvalue, and it is simple; and 
(Hi) p(A) has an eigenvector with positive components. 

In general, the spectral radius of a nonnegative irreducible matrix does 
not need to be the only eigenvalue of maximum magnitude. For example, the 

matrix has eigenvalues {1,-1}. In other words, irreducible matrices 

do indeed have weaker spectral properties than positive matrices. Therefore, 
it remains unclear which nonnegative matrices have the same properties as 
those stated for positive matrices in Theorem 1.8. 

Definition 1.12 (Primitive matrix). A nonnegative square matrix A is 
primitive if there exists k £ N such that A is positive. • 



11 
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It is easy to see that if a nonnegative square matrix is primitive, then it is 
irreducible. In later sections we will provide a graph-theoretical characteri- 
zation of primitive matrices; for now, we are finally in a position to sharpen 
the results of Theorem 1.11. 

Theorem 1.13 (Perron Frobenius for primitive matrices). If the 

nonnegative square matrix A is primitive, then 

(i) p(A) > 0; 

(ii) p(A) is an eigenvalue, it is simple, and p{A) is strictly larger than 
the magnitude of any other eigenvalue; and 

(Hi) p{A) has an eigenvector with positive components. 

We conclude this section by noting the following convergence property 
that is an immediate corollary to Lemma 1.7 and to Theorem 1.13. 

Corollary 1.14. If the nonnegative square matrix A is primitive, then the 
matrix p(A) _1 A is semi-convergent. 

1.3 DYNAMICAL SYSTEMS AND STABILITY THEORY 

In this section, we introduce some basic concepts about dynamical and con- 
trol systems; see, for example Sontag (1998) and Khalil (2002). We discuss 
stability and attractivity notions as well as the invariance principle. We con- 
clude with a treatment of set-valued systems and time-dependent systems. 



1.3.1 State machines and dynamical systems 

Here, we introduce three classes of dynamical and control systems: (i) state 
machines or discrete-time discrete-space dynamical systems; (ii) discrete- 
time continuous-space control systems; and (iii) continuous-time continuous- 
space control systems. 

We begin with our specific definition of state machine. A (deterministic, 
finite) state machine is a tuple (X,U,Xq, f), where X is a finite set called 
the state space, U is a finite set called the input space, Xq C X is the set 
of allowable initial states, and / : X x U — > X is the evolution map. Given 
an input sequence u : Z>o — > U, the state machine evolution x : Z>o — > X 
starting from x(0) £ Xq is given by 

x(£ + l) = f(x(£),u(l)), £eZ> . 

We will often refer to a state machine as a processor. Note that, in a state 
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machine, both the state and the input spaces are finite or discrete. Often 
times, we will find it useful to consider systems that evolve in continuous 
space and that are time dependent. Let us then provide two additional 
definitions in the following paragraphs. 

A (time-dependent) discrete-time continuous-space control system is a tu- 
ple (X,U,Xq, f), where X is a d-dimensional space chosen among R rf , § d , 
and the Cartesian products M, dl x S^ 2 , for some d\ + di = d, U is a com- 
pact subset of W 71 containing m , Xq C X , and / : Z>o x X x U — > X is 
a continuous map. As before, the individual objects X, U, Xq, and / are 
termed the state space, input space, allowable initial states, and evolution 
map, respectively. Given an input sequence u : Z>o — > U, the evolution 
x : Z>o — > X of the dynamical system starting from x(0) G Xq is given by 



x{£+l) = f(£,x(e),u(£)), leZ> . 



A (time- dependent) continuous-time continuous-space control system is a 
tuple (X, U, Xq, /), where A is a d- dimensional space chosen among R , 
S , and the Cartesian products Mr 1 x § , for some d\ + efo = d, U is a 
compact subset of M m containing m , Ao C X, and / : M>o x X xU —> TX 
is a continuously differentiable map. The individual objects A, [/, Ao, 
and / are termed the state space, input space, allowable initial states, and 
control vector field, respectively. Given an input function u : M>o — ► U, the 
evolution x : lR>o — > A of the dynamical system starting from x(0) £ Ao is 
given by 

x{t) = f(t,x(t),u(t)), teK> . 

We often consider the case when the control vector field can be written as 
f(t,x,u) = /o(t, x) + Yl™=i fa(t,x) u a , for some continuously differentiable 
maps fo, fi, ■ ■ ■ , fm '■ H^>o x A — > TA. Each of these individual maps is 
called a (time- dependent) vector field, and / is said to be a control- affine 
vector field. The control vector field / is driftless if f(t,x,O m ) = for all 
x G A and £ G M>o- 

Finally, the term dynamical system denotes a control system that is not 
subject to any external control action; this terminology is applicable both 
in discrete and continuous time. Furthermore, we will sometimes neglect to 
define a specific set of allowable initial states; in this case we mean that any 
point in the state space is allowable as initial condition. 
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1.3.2 Stability and attractivity notions 

In this section, we consider a continuous-space dynamical system (A, /). We 
first consider the discrete-time case and later we briefly present the analogous 
continuous-time case. We study dynamical systems that are time-invariant. 
In discrete time, a time-invariant system is simply described by an evolution 
map of the form / : X — ► X. 

Definition 1.15 (Equilibrium point). A point x* G X is an equilibrium 
point for the time-invariant dynamical system (X, f) if the constant curve 
x : Z>o — > X, defined by x{£) = x* for all £ G Z>o, is an evolution of the 
system. • 

It can immediately be seen that a point x* is an equilibrium point if and 
only if /(x*) = x*. We denote the set of equilibrium points of the dynamical 
system by Equil(A, /). 

Definition 1.16 (Trajectories and sets). Let (A,/) be a time-invariant 
dynamical system and let W be a subset of X . Then: 

(i) The set W is positively invariant for (X, /) if each evolution with 
initial condition in W remains in W for all subsequent times. 

(ii) A trajectory x : Z>o — > X approaches a set W C X if, for every 
neighborhood Y of W, there exists a time £q > such that x(£) 
takes values in Y for all subsequent times £ > £q. In such a case, we 
write x(£) — > W as £ — > +oo. • 

In formal terms, W is positively invariant if x(0) G W implies x{£) G W 
for all £ G Z>o, where x : Z>o — > X is the evolution of (A, /) starting from 
x(0). 

Definition 1.17 (Stability and attractivity). For a time-invariant dy- 
namical system (A, /), a set S is: 

(i) stable if, for any neighborhood Y of 5, there exists a neighborhood 
VF of 5 such that every evolution of (A, /) with initial condition in 
W remains in Y for all subsequent times; 

(ii) unstable if it is not stable; 

(iii) locally attractive if there exists a neighborhood Y of S such that 
every evolution with initial condition in Y approaches the set S; 
and 

(iv) locally asymptotically stable if it is stable and locally attractive. 
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Additionally, the set S is globally attractive if every evolution of the dynam- 
ical system approaches it and it is globally asymptotically stable if it is stable 
and globally attractive. • 

Remark 1.18 (Continuous-time dynamical systems). It is straight- 
forward to extend the previous definitions to the setting of continuous-time 
continuous-space dynamical systems. These notions are illustrated in Fig- 
ure 1.2. • 






Figure 1.2 Illustrations of stability, asymptotic stability, and instability. 



1.3.3 Invariance principles 

Before discussing various versions of the invariance principle, we begin with 
a useful notion. Given a discrete-time time-invariant continuous-space dy- 
namical system (X, f) and a set W C X , a function V : X — > M is non- 
increasing along f inW if V{f{x)) < V{x) for all x £ W . (Such functions 
are often referred to as Lyapunov functions.) In other words, if a function 
V is non-increasing along /, then the composite function (. \— > V(y(£)) is 
non-increasing for each evolution y of the dynamical system (X,f). The 
following theorem exploits this fact to establish useful properties of the evo- 
lutions of (X, f). 

Theorem 1.19 (LaSalle Invariance Principle for discrete-time dy- 
namical systems). Let (X,f) be a discrete-time time-independent dynam- 
ical system. Assume that: 

(i) there exists a closed set W C X that is positively invariant for 
(X,f); 



(ii) there exists a function V : X 
on W; 



that is non-increasing along f 



(Hi) all evolutions of (X, f) with initial conditions in W are bounded; 
and 



(iv) f and V are continuous on W . 
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Then each evolution with initial condition in W approaches a set of the form 
V~ 1 (c)PiS, where c is a real constant and S is the largest positively invariant 
set contained in {w G W \ V(f(w)) = V(w)}. 

We refer to Section 1.8.1 for a discussion about the proof of this result. 
Next, we present the continuous-time version of the invariance principle. In 
other words, we now assume that (X, f) is a continuous-time time-invariant 
continuous-space dynamical system. 

We begin by revisiting the notion of non-increasing function. Given a 
continuously differentiable function V : X — > R, the Lie derivative of V 
along /, denoted by CfV : X — > R, is defined by 

c,v {x) = ^v W ))\ t __, 

where the trajectory 7 : ] — e,e[ — > X satisfies j(t) = f{'y(t)) and 7(0) = x. 
If X = R d , then we can write x in components (x±, . . . , Xd) and we can give 
the following explicit formula for the Lie derivative: 

d r)V 
^fV(x) = ^2—(x)Mx). 

i=i 

Similar formulas can be obtained for more general state spaces. Note that, 
given a set W C X , a function V : X — > R is non- increasing along f in W 
if C f V(x) < for all x G W. 

Finally, we state the invariance principle for continuous-time systems. 

Theorem 1.20 (LaSalle Invariance Principle for continuous-time 
dynamical systems). Let (X,f) be a continuous-time time-independent 
dynamical system. Assume that: 

(i) there exists a closed set W C X that is positively invariant for 

(ii) there exists a function V : X — > R that is non-increasing along f 
on W ; 

(Hi) all evolutions of (X, f) with initial conditions in W are bounded; 
and 

(iv) f and V are continuously differentiable 4 on W. 

Then, each evolution with initial condition in W approaches a set of the 
form V~ l {c) n S, where c is a real constant and S is the largest positively 
invariant set contained in {w G W \ CfV(w) = 0}. 

4 It suffices that / be iocaily Lipschitz and V be continuousiy differentiabie; see Cortes (2008a). 
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1.3.4 Notions and results for set-valued systems 

Next, we focus on a more sophisticated version of the LaSalle Invariance 
Principle for more general dynamical systems, that is, dynamical systems 
described by set- valued maps that allow for non-deterministic evolutions. To 
do so, we need to present numerous notions, including set-valued dynamical 
systems, closedness properties, and weak positive invariance. 

Specifically, a discrete-time continuous-space set-valued dynamical system 
(in short, set-valued dynamical system) is determined by a tuple {X, Xq,T), 
where X is a d-dimensional space chosen among Mr, S , and the Cartesian 
products M dl x S da , for some d 1 + d 2 = d, X C X, and T : X =J X is a 
set-valued map. We assume that T assigns to each point x £ X a nonempty 
set T{x) C X. The individual objects X, Xq, and T are termed the state 
space, allowable initial states, and evolution map, respectively. An evolution 
of the dynamical system {X, Xq, T) is any trajectory x : Z>o — > X satisfying 

x{£+l)eT(x(£)), £eZ> . 

Figure 1.3 illustrates this notion. In particular, a (time- invariant) discrete- 
time continuous-space dynamical system (X, Xq, /) can be seen as a discrete- 
time continuous-space set-valued dynamical system (X,Xq,T), where the 
evolution set-valued map is just the singleton-valued map x i— > T(x) = 




>• 



Figure 1.3 A discrete-time continuous-space set-valued dynamical system. A sample evo- 
lution is shown dashed. 



Next, we introduce a notion of continuity for set- valued maps. The evolu- 
tion map T is said to be closed at x £ X if, for any sequences {xk \ k £ Z>o} 
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and {yk | k G Z>o} such that 

lim x k = x, lim y k = y, and y k G T(x fc ), 

fc— ►+oo k— >+oo 

it holds that y G T(x). The evolution set- valued map T is closed atWdX 
if for any x G W, T is closed at x. Note that a continuous map / : X — > X 
is closed when viewed as a singleton- valued map. 

(i) A set C C X is weakly positively invariant with respect to T if, for 
any x G C, there exists y G C such that n G T(x). 

(ii) A set C C X is strongly positively invariant with respect to T if 
T{x) C C for any x G C. 

A point xo is said to be a /ixed point of T if xo G T(xo). A continuous 
function V : X — > R is non-increasing along T in W G X if V(y) < F(x) 
for all x G VF and y G T{x). 

We finally state and prove a general version of the invariance principle, 
whose proof is presented in Section 1.8.1. 

Theorem 1.21 (LaSalle Invariance Principle for set- valued dis- 
crete-time dynamical systems). Let (X,Xo,T) be a discrete-time set- 
valued dynamical system. Assume that: 

(i) there exists a closed set W C X that is strongly positively invariant 
for(X,X ,T); 

(ii) there exists a function V : X — > R that is non-increasing along T 

on W; 

(Hi) all evolutions of(X, Xq, T) with initial conditions in W are bounded; 
and 

(iv) T is nonempty and closed at W and V is continuous on W. 

Then, each evolutions with initial condition in W approaches a set of the 
form F _1 (c) n S, where c is a real constant and S is the largest weakly pos- 
itively invariant set contained in {w G W \ Bw' G T(w) such that V(w') = 
V(w)}. 



1.3.5 Notions and results for time-dependent systems 

In this final subsection, we consider time-dependent discrete-time dynamical 
systems and discuss uniform stability and convergence notions. We begin 
with some uniform boundedness, stability, and attractivity definitions. 
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In what follows, given a time-dependent discrete-time dynamical system 
(X,Xq, f), an evolution with initial condition in W at time £q G Z>o is a 
trajectory x : [£q, +oo[ — > X of the dynamical system (X, Xo, /) defined by 
the initial condition x(£q) = Xo, for some xq E W. In other words, for time- 
dependent systems we will often consider trajectories that begin at time £q 
not necessarily equal to zero. 

Definition 1.22 (Uniformly bounded evolutions). A time-dependent 
discrete-time dynamical system (X, Xq, f) has uniformly bounded evolutions 
if, given any bounded set Y, there exists a bounded set W such that every 
evolution with initial condition in Y at any time £q G Z>o remains in W for 
all subsequent times £ > £q. • 

Definition 1.23 (Uniform stability and attractivity notions). For a 

time-dependent discrete-time dynamical system (X, Xq,/), the set S is: 

(i) uniformly stable if, for any neighborhood Y of S, there exists a 
neighborhood W of S such that every evolution with initial condi- 
tion in W at any time £q G Z>o remains in Y for all subsequent 
times £ > £q] 

(ii) uniformly locally attractive if there exists a neighborhood V of S 
such that every evolution with initial condition in Y at any time £q 
approaches the set S in the following time-uniform manner: 

for all £q G Z>o, for all xq G Y , and for all neighborhoods 
W of S, there exists a single tq G Z>o such that the 
evolution x : [^o,+co[ —> X defined by x(£q) = xq takes 
value in W for all times £ > £q + tq ; and 

(iii) uniformly locally asymptotically stable if it is uniformly stable and 
uniformly locally attractive. 

Additionally, the set S is uniformly globally attractive if every evolution of 
the dynamical system approaches the set in a time-uniform manner, and 
it is uniformly globally asymptotically stable if it is uniformly stable and 
uniformly globally attractive. • 

With the same notation in the definition, the set S is (non-uniformly) 
locally attractive if for all £q G Z>o, xo G Y , and neighborhoods W of S, the 
evolution x : [£o, +oo[ — > X defined by x(£q) = xq, takes value in W for all 
times £ > £q + tq{£q), for some tq{£q) G 1>>q. 

To establish uniform stability and attractivity results we will overapprox- 
imate the evolution of the time-dependent dynamical system by considering 
the larger set of evolutions of an appropriate set-valued dynamical system. 
Given a time-dependent evolution map / : Z>o xl->l, define a set-valued 
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overapproximation map Tf : X =4 X by 

T/(x) = {/(£, x)|^€Z>o}. 

With this notion we can state a useful result, whose proof is left to the 
reader as an exercise. 

Lemma 1.24 (Overapproximation Lemma). Consider a discrete-time 
time- dependent dynamical system (X,Xq, f): 

(i) If x : [£q, +oo[ — > X is an evolution of the dynamical system (X, f), 
then y : Z>o — > X defined by y(£) = xii + £q) is an evolution of the 
set-valued overapproximation system (X,Tf). 

(ii) If the set S is locally attractive for the set-valued overapproximation 
system (X,Tf), then it is uniformly locally attractive for (X, /). 

In other words, every evolution of the time-dependent dynamical system 
from any initial time is an evolution of the set-valued overapproximation 
system and, therefore, the set of trajectories of the set-valued overapproxi- 
mation system contains the set of trajectories of the original time-dependent 
system. Uniform attractivity is a consequence of attractivity for the time- 
invariant set-valued overapproximation. 

1.4 GRAPH THEORY 

Here we present basic definitions about graph theory, following the treat- 
ments in the literature; see, for example Biggs (1994), Godsil and Royle 
(2001), and Diestel (2005). 

A directed graph — in short, digraph — of order n is a pair G = (V,E), 
where V is a set with n elements called vertices (or nodes) and E is a set 
of ordered pair of vertices called edges. In other words, E C V x V. We 
call V and E the vertex set and edge set, respectively. When convenient, 
we let V(G) and E{G) denote the vertices and edges of G, respectively. For 
u, v G V, the ordered pair (u, v) denotes an edge from u to v. 

An undirected graph — in short, graph — consists of a vertex set V and of a 
set E of unordered pairs of vertices. For u, v 6 V and u / v, the set {u, v} 
denotes an unordered edge. A digraph is undirected if (v, u) £ E anytime 
(u, v) 6 E. It is possible and convenient to identify an undirected digraph 
with the corresponding graph; vice versa, the directed version of a graph 
(V, E) is the digraph (V, E') with the property that (u, v) e E' if and only 
if {u, v} G E. In what follows, our convention is to allow self-loops in both 
graphs and digraphs. 
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A digraph (V',E') is a subgraph of a digraph (V, E) if V' C V and E' G E; 
additionally, a digraph (V', E') is a spanning subgraph if it is a subgraph and 
V' = V. The subgraph of (V, E) induced by V' C V is the digraph (V, E'), 
where E' contains all edges in E between two vertices in V . For two digraphs 
G = (V,E) and G' = (V',E'), the intersection and union of G and G' are 
defined by 

GnG' = (Vnv',EnE'), 

GUG' = (VUV',E(JE'). 
Analogous definitions may be given for graphs. 

In a digraph G with an edge (u, v) & E, u is called an in-neighbor of 
v, and i> is called an out-neighbor of u. We let Mq(v) (resp., Mq(v)) 
denote the set of in-neighbors, (resp. the set of out-neighbors) of v in the 
digraph G. We will drop the subscript when the graph G is clear from the 
context. The in-degree and out-degree of v are the cardinality of Af m (v) and 
J\f out (v), respectively. A digraph is topologically balanced if each vertex has 
the same in- and out-degrees (even if distinct vertices have distinct degrees). 
Likewise, in an undirected graph G, the vertices u and v are neighbors if 
{u, v} is an undirected edge. We let Mg{v) denote the set of neighbors of 
v in the undirected graph G. As in the directed case, we will drop the 
subscript when the graph G is clear from the context. The degree of v is the 
cardinality of M(v). 

Remark 1.25 (Additional notions). For a digraph G = (V,E), the re- 
verse digraph rev(G) has vertex set V and edge set rev(E) composed of all 
edges in E with reversed direction. A digraph G = (V, E) is complete if 
E = V x V. A clique (V',E') of a digraph (V,E) is a subgraph of (V,E) 
which is complete, that is, such that E' = V x V' . Note that a clique is 
fully determined by its set of vertices, and hence there is no loss of precision 
in denoting it by V'. A maximal clique V of an edge of a digraph is a clique 
of the digraph with the following two properties: it contains the edge, and 
any other subgraph of the digraph that strictly contains (V, V x V') is not 
a clique. • 



1.4.1 Connectivity notions 

Let us now review some basic connectivity notions for digraphs and graphs. 
We begin with the setting of undirected graphs because of its simplicity. 

A path in a graph is an ordered sequence of vertices such that any pair 
of consecutive vertices in the sequence is an edge of the graph. A graph is 
connected if there exists a path between any two vertices. If a graph is not 
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connected, then it is composed of multiple connected components, that is, 
multiple connected subgraphs. A path is simple if no vertices appear more 
than once in it, except possibly for initial and final vertex. A cycle is a 
simple path that starts and ends at the same vertex. A graph is acyclic if it 
contains no cycles. A connected acyclic graph is a tree. A forest is a graph 
that can be written as the disjoint union of trees. Trees have interesting 
properties: for example, G = (V, E) is a tree if and only if G is connected 
and \E\ = \V\ — 1. Alternatively, G = (V,E) is a tree if and only if G is 
acyclic and \E\ = \V\ — 1. Figure 1.4 illustrates these notions. 




Figure 1.4 An illustration of connectivity notions on a graph. The graph has two con- 
nected components. The leftmost connected component is a tree, while the 
rightmost connected component is a cycle. 

Next, we generalize these notions to the case of digraphs. A directed path 
in a digraph is an ordered sequence of vertices such that any ordered pair of 
vertices appearing consecutively in the sequence is an edge of the digraph. 
A cycle in a digraph is a directed path that starts and ends at the same 
vertex and that contains no repeated vertex except for the initial and the 
final vertex. A digraph is acyclic if it contains no cycles. In an acyclic graph, 
every vertex of in-degree is named a source, and every vertex of out-degree 
is named a sink. Every acyclic digraph has at least one source and at least 
one sink. Figure 1.5 illustrates these notions. 



V 




(a) (b) 

Figure 1.5 Illustrations of connectivity notions on a digraph: (a) shows an acyclic digraph 
with one sink and two sources; (b) shows a directed path which is also a cycle. 

The set of cycles of a directed graph is finite. A directed graph is aperiodic 
if there exists no k > 1 that divides the length of every cycle of the graph. 
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In other words, a digraph is aperiodic if the greatest common divisor of 
the lengths of its cycles is one. A digraph is periodic if it is not aperiodic. 
Figure 1.6 shows examples of a periodic and an aperiodic digraph. 





(a) (b) 

Figure 1.6 (a) A periodic digraph, (b) An aperiodic digraph with cycles of length 2 and 3. 



A vertex of a digraph is globally reachable if it can be reached from any 
other vertex by traversing a directed path. A digraph is strongly connected 
if every vertex is globally reachable. The decomposition of a digraph into 
its strongly connected components and the notion of condensation digraph 
are discussed in Exercise El. 13. 

A directed tree (sometimes called a rooted tree) is an acyclic digraph with 
the following property: there exists a vertex, called the root, such that any 
other vertex of the digraph can be reached by one and only one directed 
path starting at the root. In a directed tree, every in-neighbor of a vertex is 
called a parent and every out-neighbor is called a child. Two vertices with 
the same parent are called siblings. A successor of a vertex u is any other 
node that can be reached with a directed path starting at u. A predecessor of 
a vertex v is any other node such that a directed path exists starting at it and 
reaching v. A directed spanning tree, or simply a spanning tree, of a digraph 
is a spanning subgraph that is a directed tree. Clearly, a digraph contains a 
spanning tree if and only if the reverse digraph contains a globally reachable 
vertex. A (directed) chain is a directed tree with exactly one source and one 
sink. A (directed) ring digraph is the cycle obtained by adding to the edge 
set of a chain a new edge from its sink to its source. Figure 1.7 illustrates 
some of these notions. 

The proof of the following result is given in Section 1.8.2. 

Lemma 1.26 (Connectivity in topologically balanced digraphs). Let 

G be a digraph. The following statements hold: 

(i) ifG is strongly connected, then it contains a globally reachable vertex 
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Figure 1.7 From left to right, tree, directed tree, chain, and ring digraphs. 

and a spanning tree; and 

(ii) if G is topologically balanced and contains either a globally reach- 
able vertex or a spanning tree, then G is strongly connected and is 
Eulerian. 5 

Given a digraph G = (V,E), an in-neighbor of a nonempty set of nodes 
U is a node v £ V \ U for which there exists an edge (v, u) £ E for some 
u&U. 

Lemma 1.27 (Disjoint subsets and spanning trees). Given a digraph 
G with at least two nodes, the following two properties are equivalent: 

(i) G has a spanning tree; and 

(ii) for any pair of nonempty disjoint subsets U\, U2 C V , either U\ has 
an in-neighbor or U2 has an in-neighbor. 




Figure 1. 




(a) 



(b) 



An illustration of Lemma 1.27. The root of the spanning tree is plotted in 
gray. In (a), the root is outside the sets U\ and t/2. Because these sets are 
non-empty, there exists a directed path from the root to a vertex in each one 
of these sets. Therefore, both U\ and t/2 have in-neighbors. In (b), the root is 
contained in U\. Because Ui is non-empty, there exists a directed path from 
the root to a vertex in U2, and, therefore, U2 has in-neighbors. The case when 
the root belongs to U2 is treated analogously. 



5 A graph is Eulerian if it has a cycle that visits all the graph edges exactly once. 
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We will postpone the proof to Section 1.8.2. The result is illustrated in 
Figure 1.8. We can also state the result in terms of global reachability: 
G has a globally reachable node if and only if, for any pair of nonempty 
disjoint subsets U±, U2 C V, either U\ has an out-neighbor or U2 has an 
out-neighbor. We let the reader give a proper definition of the out-neighbor 
of a set. 



1.4.2 Weighted digraphs 

A weighted digraph is a triplet G = (V,E,A), where the pair (V,E) is a 
digraph with nodes V = {t>i, . . . , v n }, and where the nonnegative matrix 
A G M™Q ra is a weighted adjacency matrix with the following property: for 
i,j G {1, . . . , n}, the entry a^ > if {vi,Vj) is an edge of G, and a^ = 
otherwise. In other words, the scalars aij, for all (vi,Vj) G E, are a set of 
weights for the edges of G. Note that the edge set is uniquely determined 
by the weighted adjacency matrix and it can therefore be omitted. When 
convenient, we denote the adjacency matrix of a weighted digraph G by 
A(G). Figure 1.9 shows an example of a weighted digraph. 




Figure 1.9 A weighted digraph with natural weights. 

A digraph G = (V, E) can be naturally thought of as a weighted digraph 
by defining the weighted adjacency matrix A G {0, l} nx ™ as 

a l3 = { h if (^')^ (1 . 4 .l) 

I 0, otherwise, 

where V = {vi, . . . , v n }. The adjacency matrix of a graph is the adjacency 
matrix of the directed version of the graph. Reciprocally, given a weighted 
digraph G = (V, E, A), we refer to the digraph (V, E) as the unweighted ver- 
sion of G and to its associated adjacency matrix as the unweighted adjacency 
matrix. A weighted digraph is undirected if aij = aji for alH, j G {1, . . . , n}. 
Clearly, G is undirected if and only if A(G) is symmetric. 
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Numerous concepts introduced for digraphs remain equally valid for the 
case of weighted digraphs, including the connectivity notions and the defi- 
nitions of in- and out-neighbors. 

Finally, we generalize the notions of in- and out-degree to weighted di- 
graphs. In a weighted digraph G = (V, E,A) with V = {v±, . . . ,v n }, the 
weighted out- degree and the weighted in- degree of vertex V{ are defined by, 
respectively, 

n n 

dout(vi) = ^J <Hj, and d in (vi) = ^J o^. 

3=1 3 = 1 

The weighted digraph G is weight-balanced if d ut(^i) = din(wj) for all Uj6 F. 
The weighted out-degree matrix D on t(G) and the weighted in-degree matrix 
.Din(G) are the diagonal matrices defined by 

^out(G) = diag(Al n ), and D in (G) = diag(A T l n ). 

That is, (D out (G))n = d on t(vi) and (D iQ (G))u = d in (vi), respectively. 



1.4.3 Distances on digraphs and weighted digraphs 

We first present a few definitions for unweighted digraphs. Given a digraph 
G, the (topological) length of a directed path is the number of the edges 
composing it. Given two vertices u and v in the digraph G, the distance 
from u to v, denoted dist(j(«, v), is the smallest length of any directed path 
from u to v, or +oo if there is no directed path from u to v. That is, 

distc(u, v) = min ({length(p) | p is a directed path from u to w} U{+oo}). 

Given a vertex u of a digraph G, the radius of u in G is the maximum of all 
the distances from v to any other vertex in G. That is, 

radius(f , G) = max{distG(f, u) \ u G V(G)}. 

If T is a directed tree and v is its root, then the depth of T is radius(t>,T). 
Finally, the diameter of the digraph G is 

diam(G) = max{dist(j(u, v) \ u, v G F(G)}. 

These definitions lead to the following simple results: 

(i) radius(-u, G) < diam(G) for all vertices v of G; 

(ii) G contains a spanning tree rooted at v if and only if radius(t>, G) < 
+oo; and 

(iii) G is strongly connected if and only if diam(G) < +oo. 
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The definitions of path length, distance between vertices, radius of a vertex, 
and diameter of a digraph can be easily applied to undirected graphs. 

Next, we consider weighted digraphs. Given two vertices u and v in the 
weighted digraph G, the weighted distance from u to v, denoted wdistG*(w, v), 
is the smallest weight of any directed path from utov, or +00 if there is no 
directed path from u to v. That is, 

wdistc('U, v) = min ({weight(p) | p is a directed path from u to v} U{+oo}) . 

Here, the weight of a subgraph of a weighted digraph is the sum of the 
weights of all the edges of the subgraph. Note that when a digraph is thought 
of as a weighted digraph (with the unweighted adjacency matrix (1.4.1)), the 
notions of weight and weighted distance correspond to the usual notions of 
length and distance, respectively. We leave it the reader to provide the 
definitions of weighted radius, weighted depth, and weighted diameter. 



1.4.4 Graph algorithms 

In this section, we present a few algorithms defined on graphs. We present 
only high-level descriptions and we refer to Cormen et al. (2001) for a com- 
prehensive discussion including a detailed treatment of computationally ef- 
ficient data structures and algorithmic implementations. 



1.4.4.1 Breadth-first spanning tree 

Let v be a vertex of a digraph G with radius(w, G) < +00. A breadth-first 
spanning (BFS) tree of G with respect to v, denoted TbfSi is a spanning 
directed tree rooted at v that contains a shortest path from v to every other 
vertex of G. (Here, a shortest path is one with the shortest topological 
length.) Let us provide the BFS algorithm that, given a digraph G of 
order n and a vertex v with radius (v, G) < +00, computes a BFS tree Tbfs 
rooted at v. 

[Informal description] Initialize a subgraph to contain only the 
root v. Repeat radius(t>, G) times the following instructions: 
attach to the subgraph all out-neighbors of the subgraph as well 
as a single connecting edge for each out-neighbor. The final 
subgraph is the desired directed tree. 

The algorithm is formally stated as follows: 
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function BFS(G» 



(Vi.^i) :=({«}, 0) 

for k = 2 to radius(u, G) do 

find all vertices w±, . . . , w m not in V k -i that are out-neighbors of 

some vertex in V k -\ and, for j G {1, . . . , m}, let ej be an edge 

connecting a vertex in V k -\ to Wj 

V k := Vk-iU{wi, . . . ,w m } 

Ek '■= Ek-i U{ei, . . . , e m } 
return (V n ,E n ) 



Note that the output of this algorithm is not necessarily unique, since the 
choice of edges at step 3: in the algorithm is not unique. Figure 1.10 shows 
an execution of the BFS algorithm. 








Figure 1.10 Execution of the BFS algorithm. In the leftmost frame, vertex v is colored 
in red. The other frames correspond to incremental additions of vertices and 
edges as specified by the function BFS. The output of the algorithm is a 
BFS tree of the digraph. The BFS tree is represented in the last frame with 
vertices and edges colored in red. 



Some properties of the BFS algorithm are characterized as follows. 

Lemma 1.28 (BFS tree). For a digraph G with a vertex v, any digraph 
T computed by the BFS algorithm, T g BFS(G, v), has the following 
properties: 

(i) T is a directed tree with root v; 

(ii) T contains a shortest path from v to any other vertex reachable from 
v inside G, that is, if there is a path in G from v to w, then weT 
and distG , (f, w) = distr(v, w); and 

(Hi) if G contains a spanning tree rooted at v, then T is spanning too 
and therefore, T is a BFS tree of G. 

We leave the proof to the reader. The key property of the algorithm is that 
(Vk,Ek), k G {1, . . . ,n}, is a sequence of directed trees with the property 
that (V k ,E k ) C {V k+ i,E k+1 ), for fcG {!,..., n- 1}. 



28 



"Distributed Control of Robotic Networks" by F. Bullo, J. Cortes and S. Martinez 
Copyright © 2006-2009. Manuscript under contract. This version: March 22, 2009 



DCRN March 22, 2009 



1.4.4.2 The depth-first spanning tree 

Next, we define the DFS algorithm that, given a digraph G and a vertex v 
with radius(v,G) < +oo, computes what we term a depth-first spanning 
(DFS) tree Tdfs rooted at v. 

[Informal description] Visit all nodes of the graph recording the 
traveled edges to form the desired tree. Visit the nodes in the 
following recursive way: (1) as long as a node has an unvisited 
child, visit it; (2) when the node has no more unvisited children, 
then return to its parent (and recursively attempt to visit its 
unvisited children). 

The algorithm is formally stated as a recursive procedure, as follows: 
function DFS(G,w) 

1: (^visited, ^visited) := ({^}, 0) 

2: DFS-Visit(G, v) 

3: return (Visited, -^visited) 

function DFS-Visit(G, w) 
l: for u out-neighbor of w do 
2: if u does not belong to Kdsited then 

3: Kisited : = Kdsited U{u} 

4: ^visited := ^visited U{(w, U)} 

5: DFS-VISIT(G,U) 

Note that the output of this algorithm is not necessarily unique, since the 
order in which the vertices are chosen in step l : of DFS-VlSlT is not unique. 
Any digraph T computed by the DFS algorithm, T e DFS(G, v), is a 
directed spanning tree with root v. Figure 1.11 shows an execution of the 
algorithm. 

Some properties of the DFS algorithm are characterized as follows. 

Lemma 1.29 (DFS tree). For a digraph G with a vertex v, any digraph 
T computed by the DFS algorithm, T e DFS(G, v), has the following 
properties: 

(i) T is a directed tree with root v; and 

(ii) if G contains a spanning tree rooted at v, then T is spanning too. 

Note that both BFS and DFS trees are uniquely defined once a lexico- 
graphic order is introduced for the children of a node. 
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Figure 1.11 Execution of the DFS ALGORITHM. In the top leftmost frame, vertex v is 
colored in red. The other frames correspond to incremental additions of 
vertices and edges as specified by the function DFS. The output of the 
algorithm is a DFS tree of the digraph. The DFS tree is represented in the 
last frame, with vertices and edges in red. 



1.4.4.3 The shortest-paths tree in weighted digraphs via the Dijkstra algorithm 

Finally, we focus on weighted digraphs and on the notion of weighted path 
length. Given a weighted digraph G of order n with weighted adjacency 
matrix A and a vertex v with radius(i>, G) < +oo, a shortest-paths tree of G 
with respect to v, denoted Tshortest.paths, is a spanning directed tree rooted 
at v that contains a (weighted) shortest path from v to every other vertex 
of G. This tree differs from the BFS tree defined above because here the 
path length is measured using the digraph weights. 

We now provide the Dijkstra algorithm that, given a digraph G of 
order n and a vertex v with radius(v, G) < +oo, computes a shortest-paths 
tree T short est-paths rooted at v: 

[Informal description] Incrementally construct a tree that con- 
tains only shortest paths. In each round, add to the tree (1) the 
node that is closest to the source and is not yet in the tree, and 
(2) the edge corresponding to the shortest path. The weighted 
distance to the source (required to perform step (1)) is computed 
via an array of distance estimates that is updated as follows: 
when a node is added to the tree, the distance estimates of all 
its out-neighbors are updated. 

The algorithm is formally stated as follows: 
function Dijkstra ((V, E, A), v) 

1 : J- shortest-paths ■ — v 

% Initialize estimated distances and estimated parent nodes 
2: for M£ydo 



30 



"Distributed Control of Robotic Networks" by F. Bullo, J. Cortes and S. Martinez 
Copyright © 2006-2009. Manuscript under contract. This version: March 22, 2009 



DCRN March 22, 2009 



dist(u) 




u = v , 
otherwise. 



5 
6 

7 
8 
9 
10 
11 
12 
13 



parent(n) := u 
% Main loop to grow the tree and update estimates 
while (T s hortest-paths does not contain all vertices) do 
find vertex u outside T s h rtest-paths with smallest dist(u) 
add to T shortest _paths the vertex u 

ilu^v, add to T sho rtest-paths the edge (parent (u), u) 
for each node w that is an out-neighbor of u in (V, E, A) do 
if dist(u;) > dist(tt) + a uw then 
dist(w) := dist(u) + a uw 
parent(tu) := u 

return T s hortest-paths 



Note that the output of this algorithm is not necessarily unique, since the 
choice of vertex at step 6: in the algorithm is not unique. Figure 1.12 shows 
an execution of the the Dijkstra algorithm. 









Figure 1.12 Execution of the Dijkstra algorithm on the weighted digraph plotted in 
Figure 1.9. In the top leftmost frame, vertex v is colored in gray. The other 
frames correspond to incremental additions of vertices and edges as specified 
by the function Dijkstra. The output of the algorithm is a shortest-paths 
tree of the digraph rooted at v. This tree is represented in the last frame with 
vertices and edges colored in gray. 

The following properties of the Dijkstra algorithm mirror those of the 
BFS algorithm in Lemma 1.28. 

Lemma 1.30 (Dijkstra algorithm). For a weighted digraph G with a 
vertex v, any digraph T computed by the Dijkstra algorithm, T g 
Dijkstra(G,u), has the following properties: 
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(i) T is a directed tree with root v; 

(ii) T contains a shortest path from v to any other vertex reachable from 
v inside G, that is, if there is a path in G from v to w, then w 6 T 
and wdistG(w, w) = wdist^f, w); and 

(Hi) if G contains a spanning tree rooted at v, then T is spanning too, 
and therefore, T is a shortest-paths tree of G. 



1.4.4.4 On combinatorial optimization problems 

We conclude this section on graph algorithms with a brief mention of classic 
optimization problems defined on graphs. Standard references on combi- 
natorial optimization include Vazirani (2001) and Korte and Vygen (2005). 
Given a weighted directed graph G, classical combinatorial optimization 
problems include the following: 

Minimum-weight spanning tree. A minimum-weight spanning tree of 
G, denoted MST, is a spanning tree with the minimum possible weight. 
In order for the MST to exist, G must contain a spanning tree. If all 
the weights of the individual edges are different, then the MST is 
unique. 

Traveling salesperson problem. A traveling salesperson tour of G, de- 
noted TSP, is a cycle that passes through all the nodes of the digraph 
and has the minimum possible weight. In order for the TSP to exist, 
G must contain a cycle through all nodes. 

Multicenter optimization problems. Given a weighted digraph G with 
vertices V = {v±, . . . ,v n } and a set U = {u±,...,Uk} C V, the 
weighted distance from v 6 V to the set U is the smallest weighted 
distance from v to any vertex in {u±, . . . ,Uk}. We now consider the 
cost functions H max , TLy, '■ V k — > R defined by 

Hmex.{u\, ...,u k )= max min wdist G (ui, u h ), 

ie{l,...,n} h£{l,...,k} 

n 

Hj:(ui,...,Uk) = y~] min wdist G (vi,u h ). 
f— f he{i,...,k} 

The k- center problem and the k-median problem consist of finding a set 
of vertices {u\, . . . , u^} that minimizes the k- center function 7Y max and 
the k-median function Hs, respectively. We refer to Vazirani (2001) 
for a discussion of the fc-center and A;-median problems (as well as 
the more general uncapacited facility location problem) over complete 
undirected graphs with edge costs satisfying the triangle inequality. 
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The Euclidean versions of these combinatorial optimization problems refer 
to the situation where one considers a weighted complete digraph whose 
vertex set is a point set in R , d G N, and whose weight map assigns to each 
edge the Euclidean distance between the two nodes connected by the edge. 



1.4.5 Algebraic graph theory 

Algebraic graph theory (Biggs, 1994; Godsil and Royle, 2001) is the study 
of matrices defined by digraphs: in this section, we expose two topics. First, 
we study the equivalence between properties of graphs and of their associ- 
ated adjacency matrices. We also specify how to associate a digraph to a 
nonnegative matrix. Second, we introduce and characterize the Laplacian 
matrix of a weighted digraph. 

We begin by studying adjacency matrices. Note that the adjacency matrix 
of a weighted digraph is nonnegative and, in general, not stochastic. The 
following lemma expands on this point. 

Lemma 1.31 (Weight-balanced digraphs and doubly stochastic ad- 
jacency matrices). Let G be a weighted digraph of order n with weighted 
adjacency matrix A and weighted out-degree matrix D ont . Define the matrix 

J D~ nt A, if each out-degree is strictly positive, 

\{I n + D out )~ l (I n + A), otherwise. 

Then 

(i) F is row-stochastic; and 

(ii) F is doubly stochastic ifG is weight-balanced and the weighted degree 
is constant for all vertices. 

Proof. Consider first the case when each vertex has an outgoing edge so that 
D on t is invertible. We first note that diag(t>) _1 r; = l n , for each v G (M\{0}) n . 
Therefore 

{D-^A)l n = diag(Al n )- 1 (^ll n ) = l n , 

which proves (i). Furthermore, if D out = Di n = dl n for some d G M>o, then 

{D^ t A) T l n = \{A T l n ) = Dr n l (A T l n ) = diag(^ T l n )- 1 (A T l n ) = l n , 

which proves (ii). Finally, if (V, E, A) does not have outgoing edges at each 
vertex, then apply the statement to the weighted digraph (V, E\J{(i, i) \ i G 
{l,...,n}},A + I n ). M 
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The next result characterizes the relationship between the adjacency ma- 
trix and directed paths in the digraph. 

Lemma 1.32 (Directed paths and powers of the adjacency matrix). 

Let G be a weighted digraph of order n with weighted adjacency matrix A, 
with unweighted adjacency matrix Ao,i £ {0, l} nxn ; and possibly with self- 
loops. For all i,j, k £ {1, . . . , n} 

(i) the (i,j) entry of A^ equals the number of directed paths of length 
k (including paths with self-loops) from node i to node j ; and 

(ii) the (i,j) entry of A k is positive if and only if there exists a directed 
path of length k (including paths with self-loops) from node i to 
node j . 

Proof. The second statement is a direct consequence of the first. The first 
statement is proved by induction. The statement is clearly true for k = 1. 
Next, we assume the statement is true for k > 1 and we prove it for k + 1. 
By assumption, the entry (A )ij equals the number of directed paths from 
i to j of length k. Note that each path from i to j of length k + 1 identifies 
(1) a unique node £ such that (i,£) is an edge of G and (2) a unique path 
from £ to j of length k. We write A +1 = A A in components as 

e=i 

Therefore, it is true that the entry (A k+1 )ij equals the number of directed 
paths from i to j of length k+1. This concludes the induction argument. ■ 

The following proposition characterizes in detail the relationship between 
various connectivity properties of the digraph and algebraic properties of 
the adjacency matrix. The result is illustrated in Figure 1.13 and its proof 
is postponed until Section 1.8.3. 

Proposition 1.33 (Connectivity properties of the digraph and pos- 
itive powers of the adjacency matrix). Let G be a weighted digraph 
of order n with weighted adjacency matrix A. The following statements are 
equivalent: 

(i) G is strongly connected; 

(ii) A is irreducible; and 

(Hi) ^fc=o A k is positive. 

For any j £ {1, . . . , n}, the following two statements are equivalent: 
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Figure 1.13 An illustration of Proposition 1.33. Even though vertices 2 and 3 are globally 
reachable, the digraph is not strongly connected because vertex 1 has no 
in-neighbor other than itself. Therefore, the associated adjacency matrix 
A = (ciij) with (aij) = I3, («2j) = ( a 3j) = (0, 1, 1), is reducible. 



(iv) the jth node of G is globally reachable; and 
(v) the jth column 0/ ^^~ A k has positive entries. 

Stronger statements can be given for digraphs with self-loops. 

Proposition 1.34 (Connectivity properties of the digraph and pos- 
itive powers of the adjacency matrix: cont'd). Let G be a weighted 
digraph of order n with weighted adjacency matrix A and with self-loops at 
each node. The following statements are equivalent: 

(iv) G is strongly connected; and 

(v) A" -1 is positive. 

For any j £ {1, . . . ,n}, the following two statements are equivalent: 
(iv) the jth node of G is globally reachable; and 
(v) the jth column of A 71-1 has positive entries. 

Next, we characterize the relationship between irreducible aperiodic di- 
graphs and primitive matrices (recall Definition 1.12). We will postpone the 
proof to Section 1.8.3. 

Proposition 1.35 (Strongly connected and aperiodic digraph and 
primitive adjacency matrix). Let G be a weighted digraph of order n with 
weighted adjacency matrix A. The following two statements are equivalent: 

(i) G is strongly connected and aperiodic; and 
(ii) A is primitive, that is, there exists k £ N such that A is positive. 
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This concludes our study of adjacency matrices associated to weighted 
digraphs. Next, we emphasize how all results obtained so far have analogs 
that hold when the original object is a nonnegative matrix, instead of a 
weighted digraph. 

Remark 1.36 (From a nonnegative matrix to its associated di- 
graphs). Given a nonnegative n x n matrix A, its associated weighted di- 
graph is the weighted digraph with nodes {l,...,n}, and weighted adja- 
cency matrix A. The unweighted version of this weighted digraph is called 
the associated digraph. The following statements are analogs of the previous 
lemmas: 

(i) if A is stochastic, then its associated digraph has weighted out- 
degree matrix equal to I n ; 

(ii) if A is doubly stochastic, then its associated weighted digraph is 
weight-balanced and, additionally, both in-degree and out-degree 
matrices are equal to I n ; and 

(iii) A is irreducible if and only if its associated weighted digraph is 
strongly connected. • 

So far, we have analyzed in detail the properties of adjacency matrices. 
We conclude this section by studying a second relevant matrix associated 
to a digraph, called the Laplacian matrix. The Laplacian matrix of the 
weighted digraph G is 

L(G) = D ont (G)-A(G). 

Some immediate consequences of this definition are the following: 

(i) L(G)l n = n , that is, is an eigenvalue of L(G) with eigenvector 

(ii) G is undirected if and only if L(G) is symmetric; and 

(iii) L(G) equals the Laplacian matrix of the digraph obtained by adding 
to or removing from G any self- loop with arbitrary weight. 

Further properties are established as follows. 

Theorem 1.37 (Properties of the Laplacian matrix). Let G be a 

weighted digraph of order n. The following statements hold: 

(i) all eigenvalues of L(G) have nonnegative real part (thus, if G is 
undirected, then L(G) is symmetric positive semidefinite); 

(ii) if G is strongly connected, then rank(L(G)) = n — 1, that is, is a 
simple eigenvalue of L(G); 
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(Hi) G contains a globally reachable vertex if and only «/ rank(L(G)) = 
n — 1; 

(iv) the following three statements are equivalent: 

(a) G is weight-balanced; 

(b) llL{G) = Ol; and 

(c) L(G) + L(G) T is positive semidefinite. 

1.5 DISTRIBUTED ALGORITHMS ON SYNCHRONOUS 
NETWORKS 

Here, we introduce a synchronous network as a group of processors with 
the ability to exchange messages and perform local computations. What we 
present is a basic classic model studied extensively in the distributed algo- 
rithms literature. Our treatment is directly adopted with minor variations, 
from the texts by Lynch (1997) and Peleg (2000). 

1.5.1 Physical components and computational models 

Loosely speaking, a synchronous network is a group of processors, or nodes, 
that possess a local state, exchange messages along the edges of a digraph, 
and compute an update to their local state based on the received messages. 
Each processor alternates the two tasks of exchanging messages with its 
neighboring processors and of performing a computation step. Let us begin 
by describing what constitutes a network. 

Definition 1.38 (Network). The physical component of a synchronous 
network S is a digraph (I, E cmm ), where: 

(i) / = {1, . . . , n} is called the set of unique identifiers (UIDs); and 

(ii) -Ecmm is a set of directed edges over the vertices {1, . . . , n}, called 
the communication links. • 

In general, the set of unique identifiers does not need to be n consecutive 
natural numbers, but we adopt this convention for simplicity. The set E cmm 
models the topology of the communication service among the nodes: for 
i, j £ {1, . . . , n}, processor i can send a message to processor j if the directed 
edge (i, j) is present in .Ecmm- Note that, unlike the standard treatments 
in Lynch (1997) and Peleg (2000), we do not assume the digraph to be 
strongly connected; the required connectivity assumption will be specified 
on a case- by-case basis. 
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Next, we discuss the state and the algorithms that each processor possesses 
and executes, respectively. By convention, we let the superscript [i] denote 
any quantity associated with the node i. 

Definition 1.39 (Distributed algorithm). A distributed algorithm VA 
for a network S consists of the sets 

(i) A, a set containing the null element, called the communication 
alphabet — elements of A are called messages; 

(ii) WW, i £ I, called the processor state sets; and 
(hi) Wq C WW, i € I, sets of allowable initial values; 

and of the maps 

(i) msgW : W^' X I — ► A, i £ I, called message-generation functions; 
and 

(ii) stfW : jyH xA"-» W^\ i £ I, called state-transition functions. 

If W® = W, msgW = msg, and stf^ = stf for all i £ I, then VA is said to 
be uniform and is described by a tuple (A, W, {W }jg/, msg, stf). • 

Now, with all elements in place, we can explain in more detail how a 
synchronous network executes a distributed algorithm (see Figure 1.14). 
The state of processor i is a variable vjW g WW, initially set equal to an 



Transmit 



Update 



and | A V I processor 

state 



Figure 1.14 The execution of a distributed algorithm by a synchronous network. 

allowable value in Wq . At each time instant £ £ Z>o, processor i sends 
to each of its out-neighbors j in the communication digraph (/, E cmm ) a 
message (possibly the null message) computed by applying the message- 
generation function msg' 1 ' to the current values of its state U)W and to the 
identity j. Subsequently, but still at time instant £ £ Z>o, processor i 
updates the value of its state U)W by applying the state-transition function 
stf' 1 ' to the current value of vjW and to the messages it receives from its 
in-neighbors. At each round, the first step is transmission and the second 
one is computation. These notions are formalized in the following definition. 
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Definition 1.40 (Network evolution). Let DA be a distributed algo- 
rithm for the network S. The evolution of (5, DA) from initial conditions 

Wq G Wq , i G I, is the collection of trajectories w'- 1 ' : Z>o — > W^, i £ /, 
satisfying 

u; [l] (^) = stf [l] (u; W (^-l),y [il W) 1 



where iiu*l(— 1) = tt> , i G /, and where the trajectory j/M : Z>o — > A™ 
(describing the 
j G J, given by 



(describing the messages received by processor i) has components y {(.), for 



cmmi 



y®U) = ( ms g b V% " 1),0, if (J,») G ^ 

J [null, otherwise. 

Let ^ i— > u; (^) = (w^'(£), . . . ,w>- n >(£)) denote the collection of trajectories. 



• 



We conclude this section with two sets of remarks. We first discuss some 
aspects of our communication model that have a large impact on the subse- 
quent development. We then collect a few general comments about control 
structures and failure modes relevant in the study of distributed algorithms 
on networks. 



Remarks 1.41 (Aspects of the communication model). 

(i) The network S and the algorithm T>A are referred to as synchronous 
because the communications between all processors takes place at 
the same time for all processors. 

(ii) Communication is modeled as a so-called "point-to-point" service: a 
processor can specify different messages for different out-neighbors 
and knows the processor identity corresponding to any incoming 
message. 

(iii) Information is exchanged between processors as messages, that is, 
elements of the alphabet A; the message null indicates no commu- 
nication. Messages might encode logical expressions such as true 
and false, or finite-resolution quantized representations of integer 
and real numbers. 

(iv) In some uniform algorithms, the messages between processors are 
the processors' states. In such cases, the corresponding commu- 
nication alphabet is A = W U{null} and the message-generation 
function msg std (u;, j) = w is referred to as the standard message- 
generation function. • 
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Remarks 1.42 (Advanced topics: Control structures and failures). 

(i) Processors in a network have only partial information about the 
network topology. In general, each processor only knows its own 
UID, and the UID of its in- and out-neighbors. Sometimes we will 
assume that the processor knows the network diameter. In some 
cases (Peleg, 2000), actively running networks might depend upon 
"control structures," that is, structures that are computed at ini- 
tial time and are exploited in subsequent algorithms. For example, 
routing tables might be computed for routing problems, "leader" 
processors might be elected, and tree structures might be computed 
and represented in a distributed manner for various tasks; for ex- 
ample, coloring or maximal independent set problems. We present 
some sample algorithms to compute these structures below. 

(ii) A key issue in the study of distributed algorithms is the possible 
occurrence of failures. A network might experience intermittent 
or permanent communication failures: along given edges, a null 
message or an arbitrary message might be delivered instead of the 
intended value. Alternatively, a network might experience various 
types of processor failures: a processor might transmit only null 
messages (i.e., the msg function always returns null), a processor 
might quit updating its state (i.e., the stf function neglects incoming 
messages and returns the current state value), or a processor might 
implement arbitrarily modified msg and stf functions. The latter 
situation, in which completely arbitrary and possibly malicious be- 
havior is adopted by faulty nodes, is referred to as a Byzantine 
failure in the distributed algorithms literature. • 



1.5.2 Complexity notions 

Here, we begin our analysis of the performance of distributed algorithms. 
We introduce a notion of algorithm completion and, in turn, we introduce 
the classic notions of time, space, and communication complexity. 

Definition 1.43 (Algorithm completion). We say that an algorithm 
terminates when only null messages are transmitted and all processors' 
states become constants. • 



Remarks 1.44 (Alternative termination notions). 

(i) In the interest of simplicity, we have defined evolutions to be un- 
bounded in time and we do not explicitly require algorithms to 
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actually have termination conditions, that is, to be able to detect 
when termination takes place. 

(ii) It is also possible to define the termination time as the first instant 
when a given problem or task is achieved, independently of the fact 
that the algorithm might continue to transmit data subsequently. • 

Definition 1.45 (Time complexity). The (worst-case) time complexity 
of a distributed algorithm VA on a network S, denoted TC(VA), is the 
maximum number of rounds required by the execution of T>A on S among 
all allowable initial states until termination. • 

Next, it is of interest to quantify the memory and communication re- 
quirements of distributed algorithms. From an information theory view- 
point (Gallager, 1968), the information content of a memory variable or of 
a message is properly measured in bits. On the other hand, it is convenient 
to use the alternative notions of "basic memory unit" and "basic message." 
It is customary (Peleg, 2000) to assume that a "basic memory unit" or a 
"basic message" contains log(n) bits; so that, for example, the information 
content of a robot identifier i £ {l,...,n} is log(n) bits or, equivalently, 
one "basic memory unit." Note that elements of the processor state set W 
or of the alphabet set A might amount to multiple basic memory units or 
basic messages; the null message has zero cost. Unless specified otherwise, 
the following definitions and examples are stated in terms of basic memory 
units and basic messages. 

Definition 1.46 (Space complexity). The (worst-case) space complexity 
of a distributed algorithm VA on a network S, denoted by SC(H4), is the 
maximum number of basic memory units required by a processor executing 
VA on S among all processors and among all allowable initial states until 
termination. • 

Remark 1.47 (Space complexity conventions). By convention, each 
processor knows its identity, that is, it requires log(n) bits to represent its 
unique identifier in a set with n distinct elements. We do not count this cost 
in the space complexity of an algorithm. • 

Next, we introduce a notion of communication complexity. 

Definition 1.48 (Communication complexity). The (worst-case) com- 
munication complexity of a distributed algorithm VA on a network S, de- 
noted by CC(VA), is the maximum number of basic messages transmitted 
over the entire network during the execution of VA among all allowable 
initial states until termination. • 
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We conclude this section by discussing ways of quantifying time, space 
and communication complexity. The idea, borrowed from combinatorial op- 
timization, is to adopt asymptotic "order of magnitude" measures. Formally, 
complexity bounds will be expressed with respect to the Bachmann-Landau 
symbols O, £1 and O defined in Section 1.1. Let us be more specific: 

(i) we will say that an algorithm has time complexity of order 0(/(n)) 
over some network if, for all n, there exists a network of order n 
and initial processor values such that the time complexity of the 
algorithm is greater than a constant factor times /(n); 

(ii) we will say that an algorithm has time complexity of order 0{f{n)) 
over arbitrary networks if, for all n, for all networks of order n and 
for all initial processor values, the time complexity of the algorithm 
is lower than a constant factor times f(n); and 

(iii) we will say that an algorithm has time complexity of order G(/(n)) 
if its time complexity is of order fi(/(n)) over some network and 
0(f(n)) over arbitrary networks at the same time. 

Similar conventions will be used for space and communication complexity. 

In many cases, the complexity of an algorithm will typically depend upon 
the number of vertices of the network. It is therefore useful to present a 
few simple facts about these functions now. Over arbitrary digraphs S = 
(I, E cmm ) of order n, we have 

diam(5) £ 0(n), \E cmm (S)\ £ 0(n 2 ) and radius(i>,5) £ 0(diam(5)), 

where v is any vertex of S. 

Remark 1.49 (Additional complexity notions). Numerous variations 
of the proposed complexity notions are possible and may be of interest. 

Global lower bounds. In the definition of lower bound, consider the logic 
quantifier describing the role of the network. The lower bound state- 
ment is "existential" rather than "global," in the sense that the bound 
does not hold for all graphs. As discussed in Peleg (2000), it is pos- 
sible to define also "global" lower bounds, that is, lower bounds over 
all graphs, or lower bounds over specified classes of graphs. 

Average complexity notions. The proposed complexity notions focus on 
the worst-case situation. It is possible to define expected or average 
complexity notions, where one is interested in characterizing, for ex- 
ample, the average number of rounds required or the average number 
of basic messages transmitted over the entire network during the al- 
gorithm execution among all allowable initial states until termination. 
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Problem complexity. It is possible to define complexity notions for prob- 
lems, rather than algorithms, by considering, for example, the worst- 
case optimal performance among all algorithms that solve the given 
problem, or over classes of algorithms or classes of graphs. • 



1.5.3 Broadcast and BFS tree computation 

In the following, we consider some basic algorithmic problems such as the 
simple one-to-all communication task — that is, broadcasting — and the es- 
tablishment of some "control structures" (see Remarks 1.42), such as the 
construction of a BFS spanning tree and the election of a leader. 

Problem 1.50 (Broadcast). Assume that a processor, called the source, 
has a message, called the token. Transmit the token to all others processors 
in the network. • 

Note that existence of a spanning tree rooted at the source is a neces- 
sary requirement for the broadcast problem to be solvable. We begin by 
establishing some analysis results for the broadcast problem. 

Lemma 1.51 (Complexity lower bounds for the broadcast prob- 
lem). Let S be a network containing a spanning tree rooted at v. The 
broadcast problem for S from the source v has communication complexity 
lower bounded by n — 1 and time complexity lower bounded by radius(u,<S). 

In what follows, we shall solve the broadcast problem while simultaneously 
also considering the following problem. 

Problem 1.52 (BFS tree computation). Let S be a network containing 
a spanning tree rooted at v. Compute a distributed representation for a 
BFS tree rooted at v. • 

We add two remarks on the BFS tree computation problem: 

(i) By a distributed representation of a directed tree with bounded 
memory at each node, we mean the following: each child vertex 
knows the identity of its parent and the root vertex knows that it 
has no parents. A more informative structure would require each 
parent to know the identity of its children; this is easy to achieve 
on undirected digraphs. 

(ii) The BFS tree computation has the same lower bounds as the broad- 
cast problem. 
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An elegant and classic solution to the broadcast and BFS tree compu- 
tation problems is given by the FLOODING ALGORITHM. This algorithm 
implements the same "breadth-first search" mechanism of the (centralized) 
BFS algorithm characterized in Lemma 1.28: 

[Informal description] The source broadcasts the token to its 
out-neighbors. In each communication round, each node deter- 
mines whether it has received a non-null message from one of 
its in-neighbors. When a non-null message is received — that is, 
the token is received — the node performs two actions. First, the 
node stores the token in the variable data (this solves the Broad- 
cast problem). Second, the node stores the identity of one of 
the transmitting in-neighbors in the variable parent (this solves 
the BFS tree computation problem). Specifically, if the message 
is received simultaneously from multiple in-neighbors, then the 
node stores the smallest among the identities of the transmitting 
in-neighbors. In the subsequent communication round, the node 
broadcasts the token to its out-neighbors. 

To formally describe the algorithm, we assume that the node with the 
message to be broadcast is v = 1. Also, we assume that the token is a letter 
of the Greek alphabet {a, . . . ,lo}: 

Synchronous Network: S = ({1, . . . , n}, E cmm ) 
Distributed Algorithm: FLOODING 
Alphabet: A = {a, . . . , uj} U null 

Processor State: w = (parent, data, snd-f lag), where 
parent G {0, . . . , n}, initially: parent W = 1, 

parental = for all j 7^ 1 
data G A, initially: data^ = /j,, 

dataW = null for all j ^ 1 
snd-f lag G {false, true}, initially: snd-f lag' 1 ' = true, 

snd-f lag[ J l = false for j ^ 1 

function msg(w,i) 



if (parent ^ i) AND (snd-f lag = true) then 

return data 
else 

return null 



function st£(w,y) 
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l: case 

2: (data = null) AND (y contains only null messages): 

% The node has not yet received the token 
3: new-parent := null 

4: new-data := null 

5: new-snd-flag := false 

6: (data = null) AND (y contains a non-null message): 
% The node has just received the token 

new-parent := smallest UID among transmitting in-neighbors 
new-data := a non-null message 
9: new-snd-flag := true 

10: (data / null): 

% If the node already has the token, then do not re-broadcast it 
li: new-parent := parent 

12: new-data := data 

13: new-snd-flag := false 

14: return (new-parent, new-data, new-snd-flag) 

An execution of the flooding algorithm is shown in Figure 1.15. 




i 




(a) (b) 

Figure 1.15 An example execution of the flooding algorithm. The source is vertex 
1: (a) shows the network and (b) shows the BFS tree that results from the 
execution. 

This algorithm can analyzed by induction: one can show that, for d G 
{1, . . . , radius (v, S)}, every node at a distance d from the root receives a 
non-null message at round d. A summary of the results is given as follows. 



Lemma 1.53 (Complexity upper bounds for the flooding algo- 
rithm). For a networks containing a spanning tree rooted atv, the FLOOD- 
ING algorithm has communication complexity in ®(\E cmm \), time com- 
plexity in G(radius(u,5)), and space complexity in 6(1). 

We conclude the section with a final remark. 
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Remark 1.54 (Termination condition for the flooding algorithm). 

As presented, the flooding algorithm does not include a termination 
condition, that is, the processors do not have a mechanism to detect when 
the broadcast and tree computation are complete. If an upper bound on the 
graph diameter is known, then it is easy to design a termination condition 
based on this information; we do this in the next subsection. If no a priori 
knowledge is available, then one can design more sophisticated algorithms 
for networks with stronger connectivity properties. We refer to Lynch (1997) 
and Peleg (2000) for a complete discussion about this. • 



1.5.4 Leader election 

Next, we formulate another interesting problem for a network. 

Problem 1.55 (Leader election). Assume that all processors of a net- 
work have a state variable, say leader, initially set to unknwn. We say that 
a leader is elected when one and only one processor has the state variable 
set to true and all others have it set to false. Elect a leader. • 

This task that is a bit more global in nature. We display here a solution 
that requires individual processors to know the diameter of the network, 
denoted by diam(<S), or an upper bound on it: 

[Informal description] In each communication round, each agent 
sends to its out-neighbors the maximum UID it has received up 
to that time. This is repeated for diam(5) rounds. At the last 
round, each agent compares the maximum received UID with its 
own, and declares itself a leader if they coincide, or a non-leader 
otherwise. 

The algorithm is called the FLOODMAX ALGORITHM: the maximum UID in 
the network is transmitted to other agents in an incremental fashion. At 
the first communication round, agents that are neighbors of the agent with 
the maximum UID receive the message from it. At the next communication 
round, the neighbors of these agents receive the message with the maximum 
UID. This process goes on for diam(5) rounds, to ensure that every agent 
receives the maximum UID. Note that there are networks for which all agents 
receive the message with the maximum UID in fewer communication rounds 
than diam(iS). The algorithm is formally stated as follows: 

Synchronous Network: S = ({1, . . . ,n},E cram ) 
Distributed Algorithm: FLOODMAX 
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Alphabet: A = {1, . . . , n} U{null} 

Processor State: w = (my-id,max-id, leader, round), where 

my-id £ {1, . . . , n}, initially 

max-id £ {1, . . . , n}, initially 

leader £ {false, true, unknwn}, initially 

round £ {0, 1, . . . , diam(5)}, initially 



my-idH = 


= i for all i 


max-idW 


= i for all i 


leader^ 


= unknwn for all i 


roundW = 


= for all i 



function msg(u;, i) 
l: if round < diam(5) then 
2: return max-id 
3: else 
4: return null 

function sti(w,y) 

l: new-id:= maxjmax- id, largest identifier iny} 

2: case 

3: round < diam(5): new-lead := unknwn 

4: round = diam(5) AND max-id = my-id: new-lead := true 
5: round = diam(5) AND max-id > my-id: new-lead := false 

6: return (my-id, new-id, new-lead, round +1) 

Figure 1.16 shows an execution of the floodmax algorithm. Some 
properties of this algorithm are characterized in the following lemma. A 
complete analysis of this algorithm, including modifications to improve the 
communication complexity, is discussed in Lynch (1997, Section 4.1). 



^ ^ <$s -$s ^ 



Figure 1.16 Execution of the floodmax algorithm. The diameter of the network is 4. 
In the leftmost frame, the agent with the maximum UID is colored in red. 
After four communication rounds, its message has been received by all agents. 



Lemma 1.56 (Complexity upper bounds for the floodmax algo- 
rithm). For a network S containing a spanning tree, the FLOODMAX AL- 
GORITHM has communication complexity in 0(diam(5)|i? cmm |) ; time com- 
plexity equal to diam(«S), and space complexity in ©(1). 

A simplification of the floodmax algorithm leads to the Le Lann- 
Chang-Roberts algorithm (or LCR algorithm in short) for leader elec- 
tion in rings, see (Lynch, 1997, Chapter 3.3), which we describe next. The 
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LCR ALGORITHM runs on a ring digraph and does not require the agents 
to know the diameter of the network. We provide an informal and a formal 
description of the algorithm. 

[Informal description] In each communication round, each agent 
sends to its neighbors the maximum UID it has received up to 
that time. (Agents do not record the number of communication 
rounds.) When the agent with the maximum UID receives its 
own UID from an in-neighbor, it declares itself the leader. 



Synchronous Network: ring digraph 

Distributed Algorithm: LCR 

Alphabet: A = {1, . . . , n} U{null} 

Processor State: w = (my-id,max-id, leader, snd-f lag), where 

my-id G {1, . . . , n}, initially 

max- id G {1, . . . , n}, initially 

leader G {true, false, unknwn}, initially 

snd- f 1 ag G { t rue , f al s e } , initially 



my-idW = i for all i 
max-id' 1 ' = i for all i 
leader^! — unknwn for all i 
snd-f lag' 1 ' = true for all i 



function msg(w,i) 

l: if snd-f lag = true then 

2: return max-id 

3: else 

4: return null 

function stf(w,y) 

l: case 

2: (y contains only null msgs) OR (largest identifier iny < my-id) 

3: new-id := max-id 

4: new-lead := leader 

5: new-snd-flag := false 

6: (largest identifier iny = my-id): 

7: new-id := max-id 

8: new-lead := true 

9: new-snd-flag := false 

10: (largest identifier iny > my-id): 

li: new-id := largest identifier iny 

12: new-lead := false 

13: new-snd-flag := true 

14: return (my-id, new-id, new-lead, new-snd-flag) 
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Figure 1.17 shows an execution of the LCR algorithm. The properties 
of the LCR algorithm can be characterized as follows. 








Figure 1.17 Execution of the LCR ALGORITHM. In the leftmost frame, the agent with the 
maximum UID is colored in red. After five communication rounds, this agent 
receives its own UID from its in-neighbor and declares itself the leader. 



Lemma 1.57 (Complexity upper bounds for the LCR algorithm). 

For a ring network S of order n, the LCR algorithm has communication 
complexity in 0(n 2 ), time complexity equal to n, and space complexity in 
9(1). 



1.5.5 Shortest-paths tree computation 

Finally, we consider the shortest-paths tree problem in a weighted digraph: 
in Section 1.4.4 we presented the Dukstra algorithm to solve this prob- 
lem in a centralized setting; we present here the Bellman-Ford ALGO- 
RITHM for the distributed setting. We consider a synchronous network as- 
sociated to a weighted digraph, that is, we assume that a strictly positive 
weight is associated to each communication edge. We aim to compute a tree 
containing shortest paths from a source, say node 1, to all other nodes. As 
for the computation of a BFS tree, we aim to obtain a distributed represen- 
tation of a directed tree with bounded memory at each node: 

[Informal description] Each agent maintains in its memory an es- 
timate dist of its weighted distance from the source, and an esti- 
mate parent of the in-neighbor corresponding to the (weighted) 
shortest path from the source. The dist estimate is initialized 
to for the source and to +oo for all other nodes. In each com- 
munication round, each agent performs the following tasks: (1) 
it transmits its dist value estimate to its out-neighbors, (2) it 
computes the smallest quantity among "the dist value received 
from an in-neighbor summed with the edge weight correspond- 
ing to that in-neighbor," and (3) if the agent's estimate dist is 
larger than this quantity, then the agent updates its dist and 
its estimate parent. 
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The algorithm is formally stated as follows: 



Synchronous Network with Weights: S = ({1, . . . ,n},E cmm ,A) 
Distributed Algorithm: Distributed Bellman-Ford 
Alphabet: A = R >0 UnullU{+oo} 
Processor State: w = (parent, dist), where 

parent G {1, . . . , n}, initially: parent^ = j for all j 

dist G A, initially: dataW = 0, 

data'-^ = +oo for all j / 1 



function msg(w,i) 


l: if round < n then 


2 


return dist 


3 


else 


4 


return null 


function sti(w,y) 


i 


i := processor UID 


2 


k := arginf{yj + a,j for all yj ^ null} 


3 


if (dist < k) then 


1 


return (parent, dist) 


5 


else 


6 


return (k,y k + a ki ) 



In other words, if we let di G M>oU{+oo} denote the dist variable for 
each processor i, then the Bellman- Ford algorithm is equivalent to the 
following discrete-time dynamical system: 

di(£ + 1) = inf {di(t) , mf{dj(£) + a j{ \ (j,i) G E cmm }}, 

with initial conditions d(0) = (1, +oo, . . . , +oo). (Recall that B cmm is the 
edge set and that the weights o^ are strictly positive for all (i,j) G E cmm .) 

The following formal statements may be made about the evolution of this 
algorithm. If there exists a directed spanning tree rooted at vertex 1, then all 
variables di will take a final value in time equal to their topological distance 
from vertex 1. After k communication rounds, the estimated distance at 
node i equals the shortest path of topological length at most k from the 
source to node i. Therefore, after n — 1 communication rounds, all possible 
distinct topological paths connecting source to node i have been investigated. 

The complexity properties of the distributed Bellman-Ford algo- 
rithm are described as follows. 
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Lemma 1.58 (Complexity upper bounds for the distributed Bell- 
man-Ford algorithm). For a network S of order n containing a spanning 
tree rooted at v, the distributed Bellman-Ford algorithm has com- 
munication complexity in @(n\E cmm \), time complexity equal to n — 1, and 
space complexity in 0(1). 

Figure 1.18 shows an execution of the distributed Bellman-Ford al- 
gorithm in a weighted digraph with four nodes and six edges. 





(a) 



(b) 





(c) 



(d) 



Figure 1.18 Execution of the distributed Bellman-Ford algorithm, (a) The proces- 
sor state initialization. The vertex 1 is the only one whose variable dist is 0. 
After three iterations, as guaranteed by Lemma 1.58, (d) depicts the resulting 
shortest-paths tree of the digraph rooted at vertex 1. This tree is represented 
in the last frame, with edges colored in gray. 
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1.6 LINEAR DISTRIBUTED ALGORITHMS 

Computing a linear combination of the initial states of the processors is one 
of the most basic computation that we might be interested in implementing 
on a synchronous network. More accurately, linear distributed algorithms 
on synchronous networks are discrete-time linear dynamical systems whose 
evolution map is linear and has a sparsity structure related to the network. 
These algorithms represent an important class of iterative algorithms that 
find applications in optimization, in the solution of systems of equations, 
and in distributed decision making; see, for instance Bertsekas and Tsitsiklis 
(1997). In this section, we present some relevant results on distributed linear 
algorithms. 



1.6.1 Linear iterations on synchronous networks 

Given a synchronous network S = ({l,...,n}, E cmm ), assign a scalar fji ^ 
to each directed edge (i,j) £ E CTnm . Given such scalars fji for (i,j) £ E cmm , 
the Linear combination algorithm over S is defined as follows: 

Distributed Algorithm: Linear combination 
Alphabet: A = MUnull 
Processor state: me! 

function msg(w,i) = msg std (w, i) 

function st£(w,y) 
l: i := processor UID 
2: return f u w + EjeAT'-(i) fijVj 

We assume that each processor i £ {l,...,n} knows the scalars fij, for 
j £ N m (i) U {i}, so that it can evaluate the state-transition function. Also, 
we assume that real numbers may be transmitted through a communication 
channel, that is, we neglect quantization issues in the message-generation 
function. 

In the language of Section 1.3, one can regard the Linear combination 
algorithm over S as the discrete-time continuous-space dynamical system 
(X,Xq, /), with X = Xq = W 1 and an evolution map defined by f(w) = 
F ■ w, where we define a matrix F £ M nxn with vanishing entries except 
for fji, for (i,j) £ E cmm . Note that, if A(S) denotes the adjacency matrix 
of the digraph S, then the entries of F vanish precisely when the entries of 
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A(S) T vanish. With this notation, the evolution w : Z>o — > K n with initial 
condition wq G K n is given by 

w(0)=w Q , w{£ + l) =F-w(£), £<eZ> . (1.6.1) 

Conversely, any linear algorithm of the form (1.6.1) can easily be cast as 
a Linear combination algorithm over a suitable synchronous network. 
We do this bookkeeping carefully, in order to be consistent with the notion 
of associated weighted digraph from Remark 1.36. Given F G M" xn , let 
Sf be the synchronous network with node set {1, . . . , n} and with edge set 
F C mm(F), defined by any of the equivalent statements: 

(i) (i,j) G E cmm (F) if and only if f jt / 0; or 

(ii) Sf is the reversed and unweighted version of the digraph associated 
to F. 



1.6.2 Averaging algorithms 

Here, we study linear combination algorithms over time-dependent weighted 
directed graphs; we restrict our analysis to nonnegative weights. 

Definition 1.59 (Averaging algorithms). The averaging algorithm as- 
sociated to a sequence of stochastic matrices {F(£) \ £ G Z>o} C M nxn is 
the discrete-time dynamical system 

w(£ + l) = F(£)-w(£), £tZ> . (1.6.2) 



In the literature, such algorithms are often referred to as agreement algo- 
rithms, or as consensus algorithms. 

There are useful ways to compute a stochastic matrix, and therefore, a 
time-independent averaging algorithm, from a weighted digraph; see Exer- 
cise El. 15. 

Definition 1.60 (Adjacency- and Laplacian-based averaging). Let G 

be a weighted digraph with node set {1, . . . , n}, weighted adjacency matrix 
A, weighted out-degree matrix D out , and weighted Laplacian L. Then 

(i) the adjacency-based averaging algorithm is defined by the stochastic 
matrix (I n + D oa \)~ l {I n + A) and reads in components 

1 " 

Wi (£ + 1) = ( Wi {£) + J2 <W(1)) i (1-6-3) 

J- ~r O'out\'') ■_, 
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(ii) given a positive scalar e upper bounded by min{l/d out (i) | i G 
{l,...,n}}, the Laplacian-based averaging algorithm is defined by 
the stochastic matrix I n — eL{G) and reads in components 

n n 

Wi{£+1)= (l-e Yl <Hj)wiW)+e J2 a i]Wj {(.). (1.6.4) 

These notions are immediately extended to sequences of stochastic matrices 
arising from sequences of weighted digraphs. • 

Adjacency-based averaging algorithms arising from unweighted undirected 
graphs without self-loops are also known as equal-neighbor averaging rule 
or the Vicsek's model (see Vicsek et al., 1995). Specifically, if G is an 
unweighted graph with vertices {1, . . . , n} and without self- loops, then the 
equal-neighbor averaging rule is 

w i (e + l) = avrg({w i (£)}U{w j (l)\jeNG(i)}), (1-6.5) 

where we adopt the shorthand avrg({xi, . . . , x^}) = (xi + ■ ■ • + Xk)/k. 

Remark 1.61 (Sensing versus communication interpretation of di- 
rected edges). In the definition of averaging algorithms arising from di- 
graphs, the digraph edges play the role of "sensing edges," not that of "com- 
munication edges." In other words, a nonzero entry ay, corresponding to 
the digraph edge (i,j), implies that the ith. component of the state is up- 
dated with the jth component of the state. It is as if node i could sense the 
state of node j, rather than node i transmitting to node j its own state. • 

Next, we present the main stability and convergence results for averag- 
ing algorithms associated to a sequence of stochastic matrices. We start 
by discussing equilibrium points and their stability. Recall that l n is an 
eigenvector of any stochastic matrix with eigenvalue 1 and that the diagonal 
set diag(M n ) is the vector subspace generated by l n . Therefore, any point 
in diag(M n ) is an equilibrium for any averaging algorithm. We refer to the 
points of the diag(R n ) as agreement configurations, since all the components 
of an element in diag(R n ) are equal to the same value. We will informally say 
that an algorithm achieves agreement if it steers the network state toward 
the set of agreement configurations. 

Lemma 1.62 (Stability of agreement configurations). Any averaging 
algorithm in M n is uniformly stable and uniformly bounded with respect to 
diag(R n ). 
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Regarding convergence results, we need to introduce a useful property of 
collections of stochastic matrices. Given a G ]0, 1], the set of non- degenerate 
matrices with respect to a consists of all stochastic matrices F with entries 
fij, for i, j G {1, . . . , n}, satisfying 

fii G [a, 1], and fa G {0} U[a, 1] for j / i. 

Additionally, the sequence of stochastic matrices {F{£) \ £ G Z>o} is non- 
degenerate if there exists a G ]0, 1] such that F{£) is non-degenerate with 
respect to a for all £ G Z>o- We now state the main convergence result and 
postpone its proof to Section 1.8.5. 

Theorem 1.63 (Convergence for time-dependent stochastic matri- 
ces). Let {F(£) | £ G Z>o} C W nxn be a non- degenerate sequence of stochas- 
tic matrices. For £ G Z>o, let G(£) be the unweighted digraph associated to 
F(£), according to Remark 1.36. The following statements are equivalent: 

(i) the set diag(M n ) is uniformly globally attractive for the averaging 
algorithm associated to {F(£) \ £ G Z>o}; and 

(ii) there exists a duration 5 G N such that, for all £ G Z>o, the digraph 

G(£ + l)U---UG{£ + 5) 

contains a globally reachable vertex. 

We collect a few observations about this result. 

Remarks 1.64 (Discussion of Theorem 1.63). 

(i) The statement in Theorem 1.63(i) means that each solution to the 
time-dependent linear dynamical system (1.6.2) converges uniformly 
and asymptotically to the vector subspace generated by l n . 

(ii) The necessary and sufficient condition in Theorem 1.63(h) amounts 
to the existence of a uniformly bounded time duration 5 with the 
property that a weak connectivity assumption holds over each col- 
lection of 5 consecutive digraphs. We refer to Blondel et al. (2005) 
for a counterexample showing that if the duration in Theorem 1.63 
is not uniformly bounded, then there exist algorithms that do not 
converge. 

(iii) According to Definition 1.23, uniform convergence is a property of 
all solutions to system (1.6.2) starting at any arbitrary time, and not 
only at time equal to zero. If we restrict our attention to solutions 
that only start at time zero, then Theorem 1.63 should be modified 
as follows: the statement in Theorem 1.63(i) implies, but is not 
implied by, the statement in Theorem 1.63(ii). 
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(iv) The theorem applies only to sequences of non-degenerate matri- 
ces. Indeed, there exist sequences of degenerate stochastic matrices 
whose associated averaging algorithms converge. Furthermore, one 
does not even need to consider sequences, because it is possible to 
define converging algorithms by just considering a single stochastic 
matrix. Precisely when the stochastic matrix is primitive, we al- 
ready know that the associated averaging algorithm will converge 
(see Theorem 1.13). Examples of degenerate primitive stochas- 
tic matrices (with converging associated averaging algorithms) are 
given in Exercise El. 23. We discuss time-invariant averaging algo- 
rithms in Proposition 1.68 below. • 

Theorem 1.63 gives a general result about non-degenerate stochastic ma- 
trices that are not necessarily symmetric. The following theorem presents 
a convergence result for the case of symmetric matrices (i.e., undirected 
digraphs) under connectivity requirements that are weaker (i.e., the du- 
ration does not need to be uniformly bounded) than those expressed in 
statement (ii) of Theorem 1.63. 

Theorem 1.65 (Convergence for time-dependent stochastic sym- 
metric matrices). Let {F(£) \ £ £ Z>o} C M nxn be a non-degenerate 
sequence of symmetric, stochastic matrices. Fori £ Z>o, let G(£) be the un- 
weighted graph associated to F(£), according to Remark 1.36. The following 
statements are equivalent: 

(i) the set diag(IR ra ) is globally attractive for the averaging algorithm 
associated to {F{£) \ £ £ Z>o}; and 

(ii) for all £ £ Z>o, the graph 

is connected. 

Let us particularize our discussion here on adjacency- and Laplacian-based 
averaging algorithms. 

Corollary 1.66 (Convergence of adjacency- and Laplacian-based 
averaging algorithms). Let {G{£) \ £ £ Z>o} C M nxn be a sequence of 
weighted digraphs. The following statements are equivalent: 

(i) there exists 5 £ N such that, for all £ £ Z>o, the digraph 

G(£ + l)U---UG(l + S) 

contains a globally reachable vertex; 

(ii) the set diag(R") is uniformly globally attractive for the adjacency- 
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based averaging algorithm (1.6.3) associated to {G(£) \ £ £ ^>o}>' 
and 

(Hi) the set diag(M n ) is uniformly globally attractive for the Laplacian- 
based averaging algorithm (1.6.4) (defined with e < 1/n) associated 
to {G(£) | £eZ> }. 

Finally, we refine the results presented thus far by discussing some further 
aspects. 

Proposition 1.67 (Convergence to a point in the invariant set). 

Under the assumptions in Theorem 1.63 and assuming that diag(R n ) is uni- 
formly globally attractive for the averaging algorithm, each individual evolu- 
tion converges to a specific point o/diag(R n ). 

In general, the final value upon which all Wi, i £ {1, . . . , n}, agree in the 
limit is unknown. This final value depends on the initial condition and the 
specific sequence of matrices defining the time-dependent linear algorithm. 
In some cases, however, one can compute the final value by restricting the 
class of allowable matrices. We consider two settings: time-independent 
averaging algorithms and doubly stochastic averaging algorithms. 

First, we specialize the main convergence result to the case of time- 
independent averaging algorithms. Note that, given a stochastic matrix 
F, convergence of the averaging algorithm associated to F for all initial 
conditions is equivalent to the matrix F being semi-convergent (see Defini- 
tion 1.6). 

Proposition 1.68 (Time-independent averaging algorithm). Con- 
sider the linear dynamical system on W 1 

w(£ + 1) = Fw(£), £ £ Z> . (1.6.6) 

Assume that F £ R nxn is stochastic, let G(F) denote its associated weighted 
digraph, and let v £ W 1 be a left eigenvector of F with eigenvalue 1. Assume 
either one of the two following properties: 

(i) F is primitive (i.e., G(F) is strongly connected and aperiodic); or 

(ii) F has non-zero diagonal terms and a column of F n ~ l has positive 
entries (i.e., G(F) has self-loops at each node and has a globally 
reachable node). 

Then every trajectory w of system (1.6.6) converges to (v w(0)/v T l n )l n . 



Proof. From Theorem 1.63 we know that the dynamical system (1.6.6) con- 
verges if property (ii) holds. The same conclusion follows if F satisfies prop- 
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erty (i) because of the Perron-Probenius Theorem 1.13 and Lemma 1.7. To 
computing the limiting value, note that 

v T w{£ + 1) = v T Fw(£) = v T w{£), 

that is, the quantity £ i— > v T w{£) is constant. Because F is semi-convergent 
and stochastic, we know that lim^+co w{£) = al n for some a. To conclude, 
we compute a from the relationship a(v T l n ) = lim^ +00 v T w(£) = v T w(0). 



Remarks 1.69 (Alternative conditions for time-independent aver- 
aging). 

(i) The following necessary and sufficient condition generalizes and is 
weaker than the two sufficient conditions given in Proposition 1.68: 
every trajectory of system (1.6.6) is asymptotically convergent if and 
only if all sinks of the condensation digraph of G(F) are aperiodic 
subgraphs of G(F). We refer the interested reader to Meyer (2001, 
Chapter 8) for the proof of this statement and for the related notion 
of ergodic classes of a Markov chain. Also, we refer the interested 
reader to Exercise El. 13 for the notion of condensation digraph. 

(ii) Without introducing any trajectory w, the result of the proposition 
can be equivalently stated by saying that 

lim F l = {v T l n )- l l n v T . 

Second, we focus on the case of doubly stochastic averaging algorithms. 

Corollary 1.70 (Average consensus). Let {F{£) | £ G Z>o} be a se- 
quence of stochastic matrices as in Theorem 1.63. If all matrices F{£), 
£ G Z>o, are doubly stochastic, then every trajectory w of the averaging 
algorithms satisfies 

n n 

J2m(£) = J2 Wi( ~ ^ for all £, 
i=l *=i 

that is, the sum of the initial conditions is a conserved quantity. There- 
fore, if {F(£) | £ G Z>o} is non- degenerate and satisfies property (ii) in 
Theorem 1.63, then 

1 n 
lim Wj{t) = -Yjwj(O), j G {l,...,n}. 

i=l 
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Proof. The proof of the first fact is an immediate consequence of 

n n 

£>i(* + 1) = l T n w{i + 1) = l^F(£)w(£) = 1*>(£) = ^ „,,(£). 
t=i t=i 

The second fact is an immediate consequence of the first fact. ■ 

In other words, if the matrices are doubly stochastic, then each compo- 
nent of the trajectories will converge to the average of the initial condition. 
We therefore adopt the following definition: an average- consensus averaging 
algorithm is an averaging algorithm whose sequence of stochastic matrices 
are all doubly stochastic. 

1.6.3 The convergence speed of averaging algorithms 

We know that any trajectory of the associated averaging algorithm converges 
to the diagonal set diag(M n ); in what follows we characterize how fast this 
convergence takes place. We begin with some general definitions for semi- 
convergent matrices (recall the discussion culminating in Lemma 1.7). 

Definition 1.71 (Convergence time and exponential convergence 
factor). Let A £ M nxn be semi-convergent with limit lim^+oo A 1 = A*. 

(i) For e £ ]0, 1[, the e-convergence time of A is the smallest time 
T £ (A) £ Z> such that, for all x £ M" and t > T £ (A), 

\\A e x - A*x \\ 2 < e\\x - A*x \\2. 



(ii) The exponential convergence factor of A, denoted by r exp (^4) £ 
[0,1[, is 

, l \A i xo-A*x \\ 2 \ 1 /' 
r e xp{A) = sup Inn sup I — — — : r, — 



x ^A'x ^+oo ^ IfO-^.*^o||2 



The exponential convergence factor has the following interpretation: If the 
trajectory x(€) = A^xq maximizing the sup operator has the form x{i) = 
p e (xo — x*) + x*, for p < 1, then it is immediate to see that r exp (A) = p. 

Lemma 1.72 (Exponential convergence factor of a convergent ma- 
trix). If A is a convergent matrix, then r exp (A) = p{A). 

In what follows, we are interested in studying how the convergence time 
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and the exponential convergence factor of a matrix depend upon e and upon 
the dimension of the matrix itself. 

Remark 1.73 (Complexity notions). Analogously to the treatment in 
Section 1.5.2, we introduce some complexity notions. Let A n £ M nxn , n £ N, 
be a sequence of semi-convergent matrices with limit lim^ +00 A n = A* n , and 
let £ £ ]0, 1]. We say that: 

(i) T £ (A n ) is of order Q(f(n,e)) if, for all n and all e, there exists an 
initial condition xq £ W 1 such that ||t4^ieo — A*xo||2 > dl^o - ^^oIL 
for all times £ greater than a constant factor times /(n,e); 

(ii) T £ (A n ) is of order 0(f(n,e)) if, for all n and all e, T e (A n ) is less 
than or equal to a constant factor times f(n,e); and 

(iii) T £ (A n ) is of order 0(/(n, e)) if it is both of order Q(/(n, e)) and of 
order 0(/(n,e)). • 

Lemma 1.74 (Asymptotic relationship). Let A n £ R nxn ; n £ N, be 
a sequence of semi-convergent matrices and let e £ ]0, 1]. In the limit as 

e — > + and as n — > +oo, 

Proof. By the definition of the exponential convergence factor and of lim sup, 
we know that for all r\ > 0, there exists N such that, for all £ > N, 

\\A e x - A*x \\ 2 < (r cxp (A n ) + r]Y\\x - A*x \\ 2 . 

The e-convergence time is upper bounded by any £ such that (r exp (A n ) + 
rj) < £. Selecting r] = (1 — r exp (A n ))/2, simple manipulations lead to 

--log((r exp (A n ) + l)/2) g ' 

It is also immediate to note that j^ > _ t ( - ( ^ +1 w 2 ) ; for all r £ ]0, 1[. This 
establishes the bound in the statement above. ■ 



Next, we apply the notion of convergence time and exponential conver- 
gence factor to any non-degenerate stochastic matrix whose associated di- 
graph has a globally reachable node. 

Lemma 1.75 (Exponential convergence factor of stochastic matri- 
ces). Let F be a stochastic matrix with strictly positive diagonal entries and 
whose associated digraph has a globally reachable node. Then 

r exp (F) = pess(F). 
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(From equation (1.2.1), recall that p ess (F) = max{||A||c | A G spec(F) \ 

Proof. If v G W 1 is a left eigenvector of F, then, as in Proposition 1.68, 

lim F e = F* = (v T l n )- 1 l n v T . 

£->+oo 

Relying upon v T F = v T and Fl n = l n , straightforward manipulations show 
that F* = F*F = FF* = F*F* and in turn 

pW _ p* = /p _ p*)^ - F*\ 

For any u>o G M n such that ^o 7^ F* w 0, define the error variable e(£) := 
F^wq — F*wq. Note that the error variable evolves according to e(£ + 1) = 
(F — F*)e(t) and converges to zero. Additionally, the rate at which w(£) = 
F^wq converges to F*wq is the same at which e(£) converges to zero, that 

is, 

r exp (F-F*)=r exp (F). 

Therefore, 

r exp (F) = r exp (F - F*) = p(F - F*) = p ess (F). 



The following result establishes bounds on convergence factors and conver- 
gence times for stochastic matrices arising from the equal-neighbor averaging 
rule in equation (1.6.5). 

Theorem 1.76 (Bounds on the convergence factor and the conver- 
gence time). Let G be an undirected unweighted connected graph of order 
n and let e G ]0, 1]. Define the stochastic matrix F = (I n + D{G))~ l (I n + 
A{G)). There exists 7 > (independent of n) such that the exponential 
convergence factor and convergence time of F satisfy 

r exp {F) < 1 - 7 n" 3 , and T £ (F) G 0(n 3 log e" 1 ), 

as e — > + and n — ► +00. 



1.6.4 Algorithms defined by tridiagonal Toeplitz and tridiagonal circulant 
matrices 



This section presents a detailed analysis of the convergence rates of linear 
distributed algorithms defined by tridiagonal Toeplitz matrices and by cer- 
tain circulant matrices. Let us start by introducing the family of matrices 
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under study. For n > 2 and a, b, c G M, define the nxn matrices Trid n (a, 6, c) 
and Circ n (a,6, c) by 



Trid„(a,6, c) 



6 c 
a b c 



. . . a 6 c 
... a b 



and 



Circ n (a, 6, c) = Trid n (o, b, c) + 



We call the matrices Trid„ and Circ n tridiagonal Toeplitz and tridiagonal 
circulant, respectively. The two matrices only differ in their (1, n) and (n, 1) 
entries. Note our convention that 











a 
















.. 








c 


.. 









Circ2(a, b, c) 



b a + c 
a + c b 



Note that, for a = and c/ (alternatively, o^O and c = 0), the syn- 
chronous networks defined by Trid(a, b, c) and Circ(a, b, c) are, respectively, 
the chain and the ring digraphs introduced in Section 1.4. If both a and 
c are non-vanishing, then the synchronous networks are, respectively, the 
undirected versions of the chain and the ring digraphs. 

Now, we characterize the eigenvalues and eigenvectors of Trid n and Circ n . 

Lemma 1.77 (Eigenvalues and eigenvectors of tridiagonal Toeplitz 
and tridiagonal circulant matrices). For n > 2 and a,b,c G K, the 
following statements hold: 

(i) for ac ^ 0, the eigenvalues and eigenvectors of Trid n (a,b,c) are, 
respectively, for i G { 1 , . . . , n} , 



Af) 1/2 -(^r)\ 



b + 2c\l - cos 

c \n + 1 



" 2 ^tm 



v 



a \n/ 2 . I m7r 

sin ( ^+ryy 



(ii) the eigenvalues and eigenvectors of Circ n (a, b, c) are, respectively, 
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for i £ {1, . . . , n} and u> = exp(^^ — ), 

/i2ir\ , — , . /i27r\ „_ 

b + (a + c) cos + v — l(c — a) sin £ C, 

\ n J \ n J 

and {l,u\...,u { - n - v > i ) T £ C n . 

Proof. Both facts are discussed, for example, in Meyer (2001, Example 7.2.5 
and Exercise 7.2.20). Fact (ii) requires some straightforward algebraic ma- 
nipulations. ■ 

Figure 1.19 illustrates the location of the eigenvalues of these matrices in 
the complex plane. 





(a) 

Figure 1.19 The eigenvalues of Toeplitz and circulant matrices (cf., Lemma 1.77) are 
closely related to the roots of unity. Plotted in the complex plane, the black 
disks correspond in (a) to the eigenvalues of Tridi3 (a, b,c), and in (b) to the 
eigenvalues of Circi4(0, b, c). 



Remarks 1.78 (Inclusion relationships for eigenvalues of tridiago- 
nal Toeplitz and tridiagonal circulant matrices). 

(i) The set of eigenvalues of Trid n (a, b, c) is contained in the real interval 
[b — 2y / oc, b + 2-y/ac], if ac > 0, and in the interval in the complex 
plane [b — 2\/—ly/\ac\, b + 2\/— ly/\ac\], if ac < 0. 

(ii) The set of eigenvalues of Circ n (a, b, c) is contained in the ellipse on 
the complex plane with center b, horizontal axis 2|a + c|, and vertical 
axis 2|c — a\. • 
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Next, we characterize the convergence rate of linear algorithms defined by 
tridiagonal Toeplitz and tridiagonal circulant matrices. As in the previous 
section, we are interested in asymptotic results as the system dimension 
n — > +00 and as the accuracy parameter e goes to + . 



Theorem 1.79 (Linear algorithms denned by tridiagonal Toeplitz 
and tridiagonal circulant matrices). Let n > 2, e £ ]0, 1[, and a,b,c £ 
TSL. Let x : Z>o — > M n and y : Z>o — > K ra 6e solutions to 

x(£ + 1) = Trid n (a, 6, c) x(*), y(i + 1) = Circ n (a, 6, c) y(^), 

with initial conditions x(0) = xq and y(0) = yo, respectively. The following 
statements hold: 

(i) if a = c 7^ and \b\ + 2\a\ = 1, then lim^ +00 x(£) = n with 
e-convergence time in 0(n 2 loge _1 ); 

(ii) if a / 0, c = and < |6| < 1, then lim^ +00 x{t) = n wrai/i 
e-convergence time in 0[nlogn + logs -1 ); and 

fm^ if a > 0, c > 0, 1>6>0 ami a + 6 + c = 1, £/ien lim^+oo y(£) = 
(-l^yo)ln wt/i e-convergence time in 0(n 2 loge -1 ). 

The proof of this result is reported in Section 1.8.6. Next, we extend 
these results to another interesting set of tridiagonal matrices. For n > 2 
and a,6el, define the n x n matrices ATrid^(a, 6) and ATrid~(a, 0) by 



ATrid*(a, 6) = Trid n (a, 6, a) ± 



We refer to these matrices as augmented tridiagonal matrices. If we define 



1 1 

1 


1 

1 


1 


1 



.. 

.. 

,. 

-1 1 
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and 



1 




1 













-1 




1 


1 










1 







1 


1 







(-I)"" 


-2 










1 


1 


(-1)"- 


-1 













1 



then the following similarity transforms are satisfied: 



ATrid±{a,b) = P± 



(1.6.7) 



b±2a 

Trid n _i(a, b, a) 

To analyze the convergence properties of the linear algorithms determined 
by ATrid+(a, b) and ATrid~(a, b), we will find it useful to consider the vector 

,T ft i i / t\n-2 i t\n-l\T 



1,-1,1,..., 



•ir , (-i) f *~T g 



In the following theorem, we will not assume that the matrices of interest 
are semi-convergent. We will establish convergence to a trajectory, rather 
than to a fixed point. For e £ ]0, 1[, we say that a trajectory x : Z>o — > R n 
converges to x nna i : Z>o — > R n with convergence time T £ £ Z>o if 

(i) \\x(£) - »finai(^)||2 — »■ as £ — > +00; and 

(ii) T £ is the smallest time such that \\x{£) — xgnalCQIh — e ll x (0) ~~ 
x fina i(0)|| 2 , forall£>T £ . 

Theorem 1.80 (Linear algorithms defined by augmented tridiag- 
onal matrices). Let n > 2, e £ ]0, 1[, and a, b £ R with a 7^ and 
\b\ + 2\a\ = 1. Lei x : Z>o — > R ra and 2 : Z>o — > R n 6e solutions to 

x(£ + l) = ATrid+(a,b)x(£), s(£ + l) = ATrid"(a, b) z(£), 

with initial conditions x(0) = xq and z(0) = zq, respectively. The following 
statements hold: 

(i) lim^_> +00 {x(£)-x me {£)l n ) = n , where x we {£) = (^l^xo){b + 2aY , 
with e-convergence time in ©(n 2 logs -1 ); and 

(ii) lim^ +00 {z{£) - z &we (£)l n J) = n , where z ave (£) = (^l^_z )(6 - 
2aY, with e-convergence time in 0(n 2 loge -1 ). 

The proof of this result is reported in Section 1.8.6. 

Remark 1.81 (From Toeplitz to stochastic matrices). A tridiagonal 
Toeplitz matrix is not stochastic unless its off-diagonal elements are zero. 
The tridiagonal circulant matrices Circ n and augmented tridiagonal ma- 
trices ATrid^ studied in Theorem 1.79(iii) and Theorem 1.80(i) are slight 
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modifications of tridiagonal Toeplitz matrices and are doubly stochastic. In- 
deed, the evolutions converge to the average consensus value, as predicted by 
Corollary 1.70. Note that convergence times obtained for Circ n and ATrid^ 
are consistent with the upper bound predicted by Theorem 1.76. • 

We conclude this section with some useful bounds. 

Lemma 1.82 (Bounds on vector norms). Assume that x G M n , y G 
M n_1 , and z G R n_1 jointly satisfy 



x = P. 



x = P. 



Then 2IMI2 < II 2/ 1 1 2 < (n — 1)IW|2 and |||x||2 < 1Mb < (n — l)||a;||2. 

The proof of this result is based on spelling out the coordinate expressions 
for x, y, and z, and is left to the reader as Exercise El. 29. 

1.7 NOTES 

Dynamical systems and stability theory 

Our definition of a state machine is very basic; more general definitions of 
state machines can be found in the literature (see Sipser, 2005), but the one 
presented in this chapter is sufficient for our purposes. 

The literature on dynamical and control systems is vast. The main 
tool that we use in later chapters is the LaSalle Invariance Principle, ob- 
tained by LaSalle (1960) and discussed in LaSalle (1986); see also the earlier 
works by Barbasin and Krasovskh (1952) and Krasovskh (1963) for related 
versions. Relevant sample references include modern texts on dynamical 
systems (Guckenheimer and Holmes, 1990), linear control systems (Chen, 
1984), nonlinear control systems (Khalil, 2002), robust control (Dullerud 
and Paganini, 2000), and discrete-event systems (Cassandras and Lafortune, 
2007). 



Graph theory 

The basic definitions of graph theory are standard in the literature; see, for 
example, Biggs (1994), Godsil and Royle (2001), and Diestel (2005). The 
discussion about graph algorithms is taken from Cormen et al. (2001), which 
also contains detailed discussion on implementation and complexity issues. 
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Regarding Section 1.4.4.4, standard references on combinatorial optimiza- 
tion include Vazirani (2001) and Korte and Vygen (2005). 

In Section 1.4.5, all statements about powers of the adjacency matrix are 
standard results in algebraic graph theory; see, for example Biggs (1994) 
and Godsil and Royle (2001). Lemma 1.27 is a recent result from Lin et al. 
(2005) andMoreau (2005). Proposition 1.35, on the fact that a weighted 
digraph is aperiodic and irreducible if and only if its adjacency matrix is 
primitive, is related to standard results in the theory of Markov chains; see, 
for example Seneta (1981) and Meyn and Tweedie (1999). Our proof adopts 
the approach in Lin (2005). Laplacian matrices have numerous remarkable 
properties; two elegant surveys are Mohar (1991) and Merris (1994). The- 
orem 1.37, characterizing the properties of the Laplacian matrix, contains 
some recent results. A proof of statement (ii) is given in Olfati-Saber and 
Murray (2004); in our proof, we follow the approach in Francis (2006). State- 
ment (hi) is proved by Lin et al. (2005) and Francis (2006); the following 
equivalent version is proved in Ren and Beard (2005): a weighted digraph G 
contains a spanning tree if and only if rank(L(rev(G))) = n — 1. Regarding 
statement (iv), the equivalence between (iv)a and (iv)b is proved by Olfati- 
Saber and Murray (2004) and the equivalence between (iv)b and (iv)c is 
proved by Moreau (2005). 



Distributed algorithms 

Our discussion of distributed algorithms is extremely incomplete. We have 
only presented a few token ideas and we refer to the textbooks by Lynch 
(1997) and Pcleg (2000) for detailed treatments. Let us mention briefly that 
many more efficient algorithms are available in the literature — for exam- 
ple, the GHS algorithm (Gallager et al., 1983) for minimum spanning tree 
computation and consensus algorithms with communication and processors 
faults; much attention is dedicated to fault tolerance in asynchronous sys- 
tems with shared memory and in asynchronous network systems. 



Linear distributed algorithms 

Distributed linear algorithms — and, in particular, averaging iterations that 
achieve consensus among processors — have a long and rich history. The 
richness comes from the vivid analogies with physical processes of diffusion, 
with Markov chain models, and with the sharp theory of positive matrices 
developed by Perron and Frobenius. What follows is a necessarily incom- 
plete list. An early reference on averaging opinions and achieving consensus 
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is DeGroot (1974). An early reference on the connection between averaging 
algorithms, the products of stochastic matrices, and ergodicity in inhomo- 
geneous Markov chains is Chatterjee and Seneta (1977) - the history of 
inhomogeneous Markov chains being a classic topic since the early twen- 
tieth century. The stochastic setting was investigated in Cogburn (1984). 
Load balancing with divisible tasks in parallel computers is discussed in Cy- 
benko (1989). A comprehensive theory of asynchronous parallel processors 
implementing distributed gradient methods and time-dependent averaging 
algorithms is developed in the series of works Tsitsiklis (1984), Tsitsiklis 
et al. (1986), and Bertsekas and Tsitsiklis (1997). Much interest for aver- 
aging algorithms arose from the influential work on flocking by Jadbabaie 
et al. (2003). Sharp conditions for convergence for the time-dependent set- 
ting were obtained in Moreau (2005). Finally, proper attention was given to 
the average consensus problem in Olfati-Saber and Murray (2004). 

Regarding Theorem 1.63, characterizing the convergence of averaging al- 
gorithms defined by sequences of stochastic matrices, we note that: (1) 
the PhD thesis Tsitsiklis (1984) established convergence under a strong- 
connectivity assumption; (2) a sufficient condition was independently re- 
discovered in Jadbabaie et al. (2003), adopting a result from Wolfowitz 
(1963); and (3) Moreau (2003, 2005) obtained the necessary and sufficient 
condition (for uniform convergence in non-degenerate sequences) involving 
the existence of a uniformly globally reachable node. The work in Moreau 
(2003, 2005) is an early reference also for Theorem 1.65; additional related 
results and a historical discussion appeared in Blondel et al. (2005) and Hen- 
drickx (2008). The estimates of the convergence factor given in Theorem 1.76 
in Section 1.6.3 were proved by Landau and Odlyzko (1981). Our treatment 
in Section 1.6.4 follows Martinez et al. (2007a). 

Among the numerous recent directions of research on consensus and av- 
eraging, we would like to mention the following: continuous-time consensus 
algorithms (Olfati-Saber and Murray, 2004; Moreau, 2004; Lin et al., 2004; 
Ren and Beard, 2005; Lin et al., 2005, 2007c), consensus over random net- 
works (Hatano and Mesbahi, 2005; Wu, 2006; Patterson et al., 2007; Picci 
and Taylor, 2007; Porfiri and Stilwell, 2007; Tahbaz-Salehi and Jadbabaie, 
2008; Fagnani and Zampieri, 2009), consensus in finite time (Cortes, 2006; 
Sundaram and Hadjicostis, 2008), consensus in small- world networks (Olfati- 
Saber, 2005; Durrett, 2006; Tahbaz-Salehi and Jadbabaie, 2007), consen- 
sus algorithms for general functions (Bauso et al., 2006; Cortes, 2008b; 
Lorenz and Lorenz, 2008; Sundaram and Hadjicostis, 2008), connections 
with the heat equation and partial difference equation (Ferrari- Trecate et al., 
2006), spatially decaying interactions (Cucker and Smale, 2007), conver- 
gence in time-delayed and asynchronous settings (Blondel et al., 2005; An- 
geli and Bliman, 2006; Fang and Antsaklis, 2008), quantized consensus 
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problems (Savkin, 2004; Kashyap et al, 2007; Carli et al., 2009; Zhu and 
Martinez, 2008b), consensus on manifolds (Scardovi et al., 2007; Sarlette 
and Sepulchre, 2009; Igarashi et ah, 2007), applications to distributed signal 
processing (Spanos et ah, 2005; Xiao et al., 2005; Olfati-Saber et ah, 2006; 
Zhu and Martinez, 2008a), characterization of convergence rates and time 
complexity (handau and Odlyzko, 1981; Olshevsky and Tsitsiklis, 2009; Cao 
et ah, 2008; Carli et al., 2008). Numerous interesting results are reported 
in recent PhD theses (Lin, 2005; Cao, 2007; horenz, 2007; Barooah, 2007; 
Carli, 2008; Hendrickx, 2008; Sarlette, 2009). Finally, we would like to point 
out two recent surveys (Olfati-Saber et ah, 2007; Ren et ah, 2007) and the 
text by (Ren and Beard, 2008). 

Synchronization is a fascinating topic related to averaging algorithms. A 
very early reference is the work by Huygens (1673) on coupled pendula. The 
synchronization of oscillators in dynamical systems has received increasing 
attention, and key references include Wiener (1958), Kuramoto (1975), Win- 
free (1980), Kuramoto (1984), Strogatz (2000), and Nijmeijer (2001); see 
also the widely accessible Strogatz (2003). Under all-to-all interactions, 
Mirollo and Strogatz (1990) prove synchronization of a collection of "inte- 
grate and fire" biological oscillators. Recent works on the Kuramoto and 
other synchronized oscillator models include Jadbabaie et al. (2004), Chopra 
and Spong (2009), Triplett et al. (2006), Papachristodoulou and Jadbabaie 
(2006), Wang and Slotine (2006). 

1.8 PROOFS 

This section gathers the proofs of the main results presented in the chapter. 

1.8.1 Proof of Theorem 1.21 

Here we provide the proof of the haSalle Invariance Principle for set-valued 
discrete-time dynamical systems. We remark that Theorem 1.19 is an im- 
mediate consequence of Theorem 1.21 and that Theorem 1.20 is proved in 
a similar way (for details, we refer to (Khalil, 2002)). 

Proof of Theorem 1.21. het 7 be any evolution of (X,Xq,T) starting from 
W . Let 0(7) denote the w-limit set 6 of the sequence 7 = {p/{tj \ I £ Z>o}; 
since W is closed, it follows that 0(7) C W . Next, we prove that ^(7) is 
weakly positively invariant. Let z £ fl('y). Then there exists a subsequence 

6 The w-limit set of a sequence 7 = {7^) | I £ Z> } is the set of points y for which there exists 
a subsequence {f(£ m ) | m £ Z> } of 7 such that lim j(£m) = V- 

~ m — > + oo 
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{li^m) | tn G Z>o} of 7 such that lim j(£ m ) = z. Consider the sequence 

— m— >+oo 

{li^m + 1) | m G Z>o}. Since this sequence is bounded, it has a convergent 
subsequence. For ease of notation, we use the same notation to refer to 
it, that is, there exists y such that lim j(£ m + 1) = y. By definition, 

m— >+oo 

y G fi(7). Moreover, using the fact that T is closed, we deduce that y G T{z). 
Therefore, f2( / y) is weakly positively invariant. 

Now, consider the sequence V o 7 = {V(7W) | ^ G Z>o}. Since 7 is 
bounded and V is non-increasing along T on W, the sequence V o 7 is 
decreasing and bounded from below, and therefore, convergent. Let ceK 
satisfy lim V{^f{i)) = c. Next, we prove that the value of V on ^(7) is 

£— >+oo 

constant and equal to c. Take any z G ^(7). Accordingly, there exists a 
subsequence {7(^771) \ tn G Z>o} such that lim 7(£ m ) = z. Since V is 

m— >+oo 

continuous, lim V( r y(£ m )) = V(z). From lim V{"f{€)) = c, we conclude 
that ^(z) = c. 

Finally, the fact that ^(7) is weakly positively invariant and V being 
constant on ^(7) implies that 

0(7) C {x G X I 3y G T(x) such that V(y) = V(x)}. 

Therefore, we conclude that lim dist( , y(£), S H V~ (c)) = 0, where S is 

£^+00 

the largest weakly positively invariant set contained in {x G X \ 3y G 
T(x) such that V{y) = V(x)}. ■ 

1.8.2 Proofs of Lemmas 1.26 and 1.27 

Proof of Lemma 1.26. The first statement is obvious. Regarding the second 
statement, we prove that a topologically balanced digraph with a globally 
reachable node is strongly connected, and leave the proof of the other case 
to the reader. We reason by contradiction. Assume that G is not strongly 
connected. Let S C V be the set of all nodes of G that are globally reachable. 
By hypothesis, 5/0. Since G is not strongly connected, we have S C 
V. Note that any outgoing edge with origin in a globally reachable node 
automatically makes the destination a globally reachable node too. This 
implies that there cannot be any outgoing edges from a node in S to a node 
in V \ S. Let v <E V \ S such that v has an out-neighbor in S (such a node 
must exist, since otherwise the nodes in S cannot be globally reachable). 
Since by hypothesis G is balanced, there must exist an edge of the form 
(w, v) G E. Clearly, w S, since otherwise v would be globally reachable 
too, which is a contradiction. Therefore, w G V \ S. Again, using the 
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fact that G is topologically balanced, there must exist an edge of the form 
(z, w) G E. As before, z G V \ S (note that z = v is a possibility). Since 
V \ S is finite and so is the number of possible edges between its nodes, 
applying this argument repeatedly, we find that there exists a vertex whose 
out-degree is strictly larger than its in-degree, which is a contradiction with 
the fact that G is topologically balanced. We refer to Cortes (2008b) for the 
proof that G is Eulerian. ■ 

Proof of Lemma 1.27. (i) ==> (ii) Assume that i G V is the root of 
the spanning tree and take an arbitrary pair of nonempty, disjoint sub- 
sets U\, Ui C V. If i G Ui, then there must exist a path from i G U\ to a 
node in U 2 . Therefore, U 2 must have an in- neighbor. Analogously, if i G U 2 , 
then U\ must have an in- neighbor. Finally, it is possible that i ^ UiUU 2 . 
In this case, there exist paths from i to both U\ and U 2 , that is, both sets 
have in- neighbors. 

(ii) ==>■ (i) This is proved by finding a node from which there exists a 
path to all others. We do this in an algorithmic manner using induction. At 
each induction step k, except the last one, four sets of nodes are considered, 
Ui(k) C W\(k) C V, U 2 (k) C W 2 (k) C V, with the following properties: 

(a) the sets W\{k) and W 2 {k) are disjoint; and 

(b) from each node of U s (k) there exists a path to each other node in 
W s (k)\U s (k),sG {1,2}. 

Induction Step k=l: Set U\ = W\ = {i\} and U 2 = W 2 = {i 2 }, where ii, i 2 
are two arbitrary different nodes of the graph that satisfy the properties (a) 
and (b). 

Induction Step k > 1: Suppose that for k — 1 we found sets U\{k — 1) C 
Wi(k - 1) and U 2 {k - 1) C W(k - 1) as in (a) and (b). Since U x {k - 1) 
and U 2 {k — 1) are disjoint, then there exists either an edge (ik,ji) with 
J! G Ui{k -l),i k eV\ Ui{k - 1), or an edge {i k ,j 2 ) with j 2 G U 2 (k - 1) 
and ik G V \U 2 (k — I). Suppose that an edge (ifc, j'2) exists (the case of a 
edge (ifc, ji) can be treated in a similar way). Only four cases are possible. 

(A) If z fc G Wi(k-l) a,ndWi(k-l)UW 2 (k-l) = V, then we can termi- 
nate the algorithm and conclude that from any node h G U±(k — 1) 
there exists a path to all other nodes in the graph and thus there is 
a spanning tree. 
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(B) If» fc £ Wi(fe-l) and Wi(fc-l)UW 2 (ife-l) / V, then set: 

tfi(fc) = tfi(fc - 1), 
Wi(ifc) = W 1 (fc-l)UW r 2 (fc-2) J 
l/ 2 (fc) = W 2 (k) = {h k }, 

where h k is an arbitrary node not belonging to W\{k—1) U W2(k — 1). 

(C) If i fc £ Wi(k-l)UW 2 (k-l), then set 

f/i(A:) = t/ 1 (fc-l), 
Wi(jfc) = W 1 (k-l), 

U 2 (k) = {i k }, 
W 2 (k) = W 2 (k-l)U{i k }. 

(D) If i k EW 2 (k-l)\ U 2 (k - 1) then 

U 1 (k) = U l (k-l), 
Wi(k) = Wi(fc-l), 

C/ 2 (fc) = C/ 2 (fc-l)U{i fc }, 
W 2 (*) = W 2 (A; - 1). 

The algorithm terminates in a finite number of induction steps because at 
each step, except when finally case (A) holds true, either the number of 
nodes in W\ U W 2 increases, or the number of nodes in W\ U W 2 remains 
constant and the number of nodes in U\ U U 2 increases. ■ 



1.8.3 Proofs of Propositions 1.33 and 1.35 

Proof of Proposition 1.33. (ii) ==? (i) We aim to show that there exist 
directed paths from any node to any other node. Fix i £ {1, . . . , n} and let 
Ri C {1, . . . , n} be the set of nodes that belong to directed paths originating 
from node i. Denote the unreachable nodes by Ui = {1, . . . , n} \ i2». We 
argue that Ui cannot contain any element, because if it does, then Ri U Ui 
is a nontrivial partition of the index set {1, . . . , n} and irreducibility implies 
the existence of a non-zero entry a,jk with j £ Ri and k £ Ui. Therefore, 
Ui = 0, and all nodes are reachable from i. The converse statement (i) ==? 
(ii) is proved similarly. 

(i) ==? (Hi) If G is strongly connected, then there exists a directed path 
of length k < n — 1 connecting any node i to any other node j. Hence, 
by Lemma 1.32(h), the entry (A k )ij is strictly positive. This immediately 
implies the statement (iii). The converse statement (Hi) ==> (i) is proved 
similarly. ■ 
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Next, we present a useful number theory result. This states that relatively 
co-prime numbers generate all sufficiently large natural numbers. 

Lemma 1.83 (Natural number combination). Let ai, . . . , a at £ N have 
greatest common divisor 1. There exists k £ N such that every number 
m > k can be written as 

m = a\a\ + • • • + ono-n, 

for appropriate numbers a±, . . . , un £ N. 

Proof. Assume that a± < ■ ■ ■ < a^ without loss of generality. From the 
generalized Bezout identity we know that, for any numbers di, . . . , ajy with 
greatest common divisor 1, there exist integers 71, ... , 7 at £ Z such that 

l = 7iaiH h7Arffl7V. (1.8.1) 

Pick k = 1 71 1 of + • • • + |7aHotv ^ ^. Every number m > k can be written as 

m = k + mqtntOl + W-rmndr, 

for appropriate numbers m q tnt > and 1 < m rmn d r < 01 • Using the defini- 
tion of k and equation (1.8.1), we write 

171 = (l7l| a l H H l7iv| a 7v) + TiqtntOl + m rmndr (7iai H h 7^^) 

= m qtnt ai + (|7i|oi + m rmndr 7i)ai H h (|7Ar|aAr + m rmndr 77v)aAr. 

The proof is now completed by noting that each integer number (|7i|ai + 
"irmndr7i), ■ ■ • , (llN^N + "irmndr7Ar) is strictly positive, because m rmndr < 
a\ < ■ ■ ■ < otv- H 

Proof of Proposition 1.35. (i) ==f- (ii) Pick any i. We claim that there 
exists a number fc(i) with the property that, for all m > k(i), we have that 
(A m )ii is positive, that is, there exists a directed path from i to i of length 
m for all m larger than a number k(i). To show this claim, let {ci, . . . , ctv} 
be the set of the cycles of G and let {£1, . . . , £n} be their lengths. Because 
G is aperiodic, Lemma 1.83 implies the existence of a number h(£\, . . . , £n) 
such that any number larger than h(£i, ■ ■ ■ ,£n) 1S a linear combination of 
£1, . . . ,£n with natural numbers as coefficients. Because G is strongly con- 
nected, there exists a path 7 of arbitrary length T(i) that starts at i, contains 
a vertex of each of the cycles Ci, . . . , cj\r, and terminates at 2. Now, we claim 
that k(i) = T(i) + h(£i, . . . ,£n) has the desired property. Indeed, pick any 
number m > k(i) and write it as k = F(i)+/3i£i + - • • + 0n£n for appropriate 
numbers Pi, ■ ■ ■ , /3/v £ N. A directed path from i to i of length m is con- 
structed by attaching to the path 7 the following cycles: (5\ times the cycle 
ci, /?2 times the cycle C2, . • . , @n times the cycle cat. Finally, having proved 
the existence of k(i) with the desired property, let K be the maximum k(i) 
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over all nodes i, and recall that diam(G) is the maximum pairwise distance 
between nodes. Clearly, A is positive for all M > K + diam(G). 

(ii) ==> (i) From Lemma 1.32 we know that A > means that there are 
paths from every node to every other node of length k. Hence, the digraph 
G is strongly connected. Next, we prove aperiodicity. Because G is strongly 
connected, each node of G has at least one outgoing edge, that is, for all 
i, there exists at least one index j such that a%j > 0. This fact implies 
that the matrix A k+1 = AA k is positive via the following simple calculation: 
(A k+1 ) u = YJh=i a ih{A k ) h i > a lj (A k ) j i > 0. In summary, we have shown 
that, if A k is positive for some k, then A m is positive for all subsequent 
m > k. Therefore, there are cycles in G of any length greater than or equal 
to k, which means that G is aperiodic. ■ 



1.8.4 Proof of Theorem 1.37 

Proof. We begin with statement (i). Let ly, for i,j £ {l,...,n}, be the 
entries of L(G). Note that la = £)?=i j+i a ij > and kj = —aij < for 
i y^ j. By the Gersgorin disks Theorem 1.2, we know that each eigenvalue 
of L(G) belongs to at least one of the disks 

n 
\z £ C | \\z- lu\\c < ^2 l^'lj = \ Z G C I H Z ~ lii ^ c - lii \- 

These disks contain the origin n and complex numbers with a positive real 
part. This concludes the proof of statement (i). 

Regarding statement (ii), note that D out (G) is invertible because G is 
strongly connected. Define the two matrices A = D ou t(G)~ 1 A(G) and L = 
D ut(G)~ 1 L(G), and note that they satisfy L = I n — A. Since D ou t(G) 
is diagonal, the matrices A(G) and A have the same pattern of zeros and 
positive entries. This observation and the assumption that G is strongly 
connected imply that A is nonnegative and irreducible. By the Perron- 
Frobenius Theorem 1.11, the spectral radius p(A) is a simple eigenvalue. 
Furthermore, one can verify that A is row-stochastic (see Lemma 1.31), 
and therefore, its spectral radius is 1 (see Exercise El. 4). In summary, we 
conclude that 1 is a simple eigenvalue of A, that is a simple eigenvalue of 
L, that L has rank n — 1, and that L{G) has rank n — 1. 

Regarding statement (iii), we first prove that rank(L(G)) = n — 1 implies 
the existence of a globally reachable vertex. By contradiction, let G con- 
tain no globally reachable vertex. Then, by Lemma 1.27, there exist two 
nonempty disjoint subsets U\, U^ C V(G) without any out-neighbor. After 
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a permutation of the vertices, the adjacency matrix can be partitioned into 
the blocks 



A{G) 



An 


A n 





A22 

A Z2 







A33 



Here, A12 and ^13 vanish because U\ does not have any out-neighbor, and 
A21 and ^23 vanish because U2 does not have any out-neighbor. Note that 
D\\ — An an d D22 — A22 are the Laplacian matrices of the graphs defined 
by restricting G to the vertices in U\ and in U2, respectively. Therefore, the 
eigenvalue has geometric multiplicity at least 2 for the matrix D out (G) — 
A{G). This contradicts the assumption that rank(L(G)) = n — 1. 

Next, still regarding statement (iii), we prove that the existence of a glob- 
ally reachable vertex implies rank(L(G)) = n— 1. Without loss of generality, 
we assume that G contains self-loops at each node (so that -D ut is invert- 
ible). Let R be the set of globally reachable vertices; let r € {1, . . . , n} be its 
cardinality. If r = n, then the graph is strongly connected and statement (ii) 
implies that rank(L(G)) = n — 1. Therefore, assume that r < n. Renumber 
the vertices so that R is the set of the first r vertices. After this permu- 
tation, the adjacency matrix and the Laplacian matrix can be partitioned 
into the blocks 



A(G) 



An 
A21 A22 



and L(G) 



Ln 
L21 




L22 



Here, A12 £ R rx ( n_r ) vanishes, because there can be no out-neighbor of R; 
otherwise that out-neighbor would be a globally reachable vertex in V \ R. 
Note that the rank of Ln £ I 
to An is strongly connected 

the rank of L22 £ R( n_r ) x ( n_r ) is full. Note that the same block partition 
applies to the matrices A = D~ ut A and L = D~ ut L considered in the proof 
of statement (ii) above. With this block decomposition, we compute 

-1 



rXr is exactly r— 1, since the digraph associated 
To complete the proof it suffices to show that 



A n- 



A n- 







A 2 i(n-1) A 



22 



for some matrix A2\(n — 1) that depends upon An, A21 and A22- Because 
a globally reachable node in G is globally reachable also in the digraph 
associated to A, Proposition 1.33(v) implies that A2i(n — 1) is positive. 
This fact, combined with the fact that A and hence A n_1 are row-stochastic, 
implies that A^ has maximal row sum (that is, oo-induced norm) strictly 
less than 1. Hence, the spectral radii of A r ^ and of A22 are strictly less 
than 1. Since A22 has spectral radius strictly less than 1, the matrix L22 — 
I n - r — A22, and in turn the matrix L22, have full rank. 

Regarding statement (iv), the equivalence between (iv)a and (iv)b is 
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proved as follows. Because Y^j=i kj — d ou t(vi) — d- m {vi) for alii G {1, . . . , n}, 
it follows that l£L(G) = 0^ if and only if D out (G) = D in (G). Next, we 
prove that (iv)b implies (iv)c. Suppose that L(G) T l n = 0^ and consider 
the system -y(t) = —L(G) n f(t), 7(0) = xo, together with the positive definite 
function V : M n — > R defined by V(x) = x T x. We compute the Lie derivative 
of the function V along the vector field x 1— > —L{G)x as V"(x) = —2x T L(G)x. 
Note that ^(sc) < 0, for all x G W 1 , is equivalent to L(G) + L(G) T > 0. 
Because l^L(G) = 0^ and L(G)l n = n , it can immediately be established 
that exp(— L(G)t), t G M., is a doubly stochastic matrix. Prom Theorem 1.1, 
we know that if we let {P a } be the set of n x n permutation matrices, then 
there exist time-dependent convex combination coefficients ^2 a X a {t) = 1, 
A«(i) > 0, such that exp(— L{G)t) = ^2 a X a (t)P a . By the convexity of V 
and its invariance under coordinate permutations, for any x G W 1 , we have 

V(eM-L(G)t)x) = V(Y, X a (t)P a x) 

a 

< Y, X a (t)V{P a x) = Y, X a (t)V(x) = V(x) . 

a a 

In other words, V(exp(— L(G)t)x) < V(x) for all x G M n , which implies 
V(x) < 0, for all x G R n . Finally, we prove that (iv)c implies (iv)b. By 
assumption, -x T (L(G) + L{G) T )x = -2x T L(G)x < for all x G R n . In 
particular, for any small e > and x = 1„ . — eL(G) r l n , 

-(1^ - el T n L{G))L{G){l n - eL(Gfl n ) = e\\L(G) T l n g + 0(e 2 ) < 0, 

which is possible only if L(G) T l n = 0„ . ■ 

1.8.5 Proofs of Theorem 1.63 and Proposition 1.67 

In this section, we prove Theorem 1.63. The exposition follows along the 
main lines of the original proof by Moreau (2005), with the variation of using 
the LaSalle Invariance Principle for set-valued dynamical systems, presented 
as Theorem 1.21. We begin with some preliminary results. 

Lemma 1.84 (Union of digraphs and sums of adjacency matrices). 

Let G±, . . . ,Gs be unweighted digraphs with common node set {1, . . . , n} and 
adjacency matrices A\, . . . , Ag. The unweighted digraph 

G 1 U ■ • • U G s = ({1, • ■ ■ , n}, E{A X ) U • • • U E(A S )) 

is equal to the unweighted digraph associated to the nonnegative matrix 
^fceli 6}Ak, that is, the unweighted digraph ({1, ... ,n},E(A\ + - ■■ + As)). 

Proof. If (i,j) G Ufc e { lv )( jj -E(Gfc), then there exists &o £ {l>--->^} such 
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that (i,j) G E(Gk )- Denoting the entries of the matrix A^ by aij(k), this 
implies that dij(ko) > 0, that ajj(l) + • • • + aij{$) > 0, and that (i,j) is an 
edge in E(A\ + • • • + As). The converse statement is easily proved with an 
analogous reasoning. ■ 

In what follows, for a G ]0, 1], let J- {a) denote the set ofnxn stochastic 
matrices that are non-degenerate with respect to a. Given a G ]0, 1] and 
SeN, define the sets F s (a) C R nxn by 

F s (a) = {F G ^(a 5 ) | 3F 1: . . . , F s G F(a) such that F = F s ■ ■ ■ Fi 

and G{F\) U • • • U G(F$) contains a globally reachable node}, 
or, equivalently by Proposition 1.33, 

F s (a) = {F £ F(a 5 ) | 3 Ft, . . . , F s G F{a) such that F = F s . . . Ft 

and a column of (F\ + • ■ ■ + F$) n has positive entries}. 

Lemma 1.85 (Compact sets of stochastic matrices). For a G ]0, 1], 

the sets J- {a) and J-$(a), 5 G N, are compact. 

Proof. All sets are clearly bounded. In Exercise El. 24, we invite the reader 
to prove that J- (a) is closed. Let us now prove that J-& (a) is closed. Consider 
a matrix sequence {F(k) \ k G N} C Ts(ol) convergent to some matrix F. 
Because T{a ) is closed, we establish that F G T(a ). Because each matrix 
F(k) belongs to Tsia), there exist matrices F\(k), . . . , F$(k) G T{a) such 
that F(k) = F$(k) ■ ■ ■ F±(k). We claim that there exists a sequence ki G N, 
for I G N, such that, for all s G {1, . . . , 5}, the matrix sequences F s (ki), I G N, 
are convergent. (To see this, note that F\(k) takes value in a compact set; 
hence it must have a convergent subsequence. Restrict i*2(&) to the instants 
of time in the convergent subsequence for F\(k) and observe that it takes 
value in a compact set, etc.) Therefore, there exist matrices F s , to which the 
matrix sequences F s (ki), I G N, converge. Taking the limit as / — > +oo in the 
equality F{k{) = F$(ki) ■ ■ ■ F\{ki), we establish that F = Fg ■ ■ ■ F\. Finally, 
it remains to be shown that a column of B := (F\ + • • • + Fg) n has positive 

entries. For k G N, define B(k) = (i ? i(fc)H \-F 5 (k)) n . Clearly, B{k) -> B 

as k — > +oo. By the definition of the sequence F(k), each B(k) = (bij{k)) 
has the property that there exists jk G {1, . . . , n} such that bij k (k) > for 
all i G {1, . . . , n}. Since {1, . . . , n} is a finite set, there exists j'o G {1, . . . , n} 
that satisfies this property for an infinite subsequence of matrices B{k{), 
I G N. With some straightforward bookkeeping, we write 

& n n 

{B{ki)) iio = J2 E • • • E c^to))^ ■ ■ ■ {FaSh)) hn . l3a . 

ai,...,a„=l hi=l h„_i=l 
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Note that, because F s (k) G T(a), for s G {1, ...,<£}, each nonzero entry 
F s (k) is lower bounded by a > 0. Furthermore, each entry (B(ki))ij is the 
sum of nonnegative terms, each of which is the product of n factors, each 
of which is lower bounded by a. Hence, because (B(kij)ij is positive, it 
is also lower bounded by a n . Since lim B{k{) = B, by the compactness 

l— >+oo 

of [a n ,l]U{0}, it must be that B = (bij) satisfies bji B > a n > for all 
j G {1, . . . , n}. In particular, this implies that F G Fsipt) and then Fs(a) is 
closed. ■ 



Finally, we are able to prove the equivalences in Theorem 1.63. 

Proof of Theorem 1.63. First, we prove that (i) implies (ii). Suppose that 
for all durations 5 G N, there exists some ^SN such that the digraph with 
edges U se [£ o / +g\ E(F(s)) does not contain a globally reachable node. By 
Lemma 1.27, there must exist a set of nodes U\, U2 C {1, . . . , n} such that 
there are no out-going edges («i,j'i), with i\ G U\, i\ G {1, . . . , n} \ U\ or 
(^2 ; J2), with j2 G U2, 12 G {1, . . . , n} \ Ui- Take any values a, b G R, a / b, 
and consider the initial conditions: 

{a, i G Ui, 

b, i G U 2 , 

cGco(a,6), i G {l,...,n}\(C/iU[/ 2 ). 
Because of the properties of U\ and U2, for all 5 G N, we must have 

{a, j G C7i, 

b, j G t/ 2 , 

cGco(a,6), je{l,...,n}\(U 1 UU 2 ). 

Because 5 can be chosen arbitrarily large, one can easily construct a con- 
tradiction with the fact that diag(M n ) is supposed to be uniformly globally 
attractive. 

Next, we show that (ii) implies (i). Let a G ]0, 1] to be the scalar with 
respect to which the sequence is non-degenerate. Consider the set-valued 
discrete-time dynamical system (M n ,M n ,r Q ,^), with evolution map T a ^ : 
R n z4 R n defined by 

T a , 5 (w) = {Fw\Fe F S (a)}. 

Because of this definition, any trajectory w : Z>o — > M n of the averaging 
algorithm (1.6.2) satisfies 

w((k + l)S)eT aS (w(kS)), fcGZ> . 
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In what follows, we intend to use the LaSalle Invariance Principle for set- 
valued discrete dynamical systems, presented as Theorem 1.21, to prove that 
lim dist(u>(£;£),diag(IR n )) = 0. This will then imply, by Lemma 1.24, the 

uniform attractivity statement in the theorem. In the following, we check 
the conditions of the theorem. 

Closedness of the set-valued dynamical system. Consider a pair of vector 
sequences {x k \ k £ N} and {yt \ k £ N} in R n such that limk^+oo%k = 
x, limfc^+ooj/fc = y, and y k £ T a> §(xk), for all k £ N. We need to show 
that y £ T at s(x). By definition of T aj $ and because yj~ £ T a j(xk), there 
exists a sequence {F(k) \ k £ N} C J-s(a) such that F{k)x k = yk, for all 
k £ N. Furthermore, since J-$ (a) is compact by Lemma 1.85, there exists 
a subsequence {F(ki) \ I £ N} that is convergent to some F £ T&(a). The 
desired conclusion follows from 

y = lim y ke = lim F(k e )x ke = Fx. 

I— >+oo I— >+oo 

Non-increasing Lyapunov function. Define the function V : M n — > M>o by 
y(x) = max Xj — min Xj. 

ie{l,...,n.} ie{l,...,n.} 

Note that V is continuous. Pick any x £ M n and any stochastic matrix 
F £ .F^ (a). Recall that HxHoo = max ie | li n y \xi\, and that ||-F||cx) = 1- 
Therefore, by the definition of the induced norm, HF'xHoo < ||^||oo- Similarly, 
in components, 

(Fx)i = Yl fiJ x J ^ ( Yl fa) , ¥? [n , Xfc ' 

v , — , ' fce{l,...,nV 
ie{i,...,n} je{l,...,n} 

which implies minjgn^ ,... n \{Fx)i > minfc g r lj ra i x^. Therefore, we have that 
V(Fx) < V(x) for all x £ M ra and F £ F,5(a). In other words, the function 
V is non- increasing along T Qi 5 in M n . 

Boundedness. It can immediately be seen that, since ||Fx||oo < ||^||oo 
for all stochastic matrices F and vectors x, the trajectory k \— > w(kd) is 
bounded. 

Invariant set. By Theorem 1.21, any trajectory of T a §, and hence also the 
trajectory w : Z>o — > M n of the averaging algorithm (1.6.2), will converge 
to the largest weakly positively invariant set contained in a level set of the 
Lyapunov function V and in a set where the Lyapunov function does not 
decrease along T. In the following, we determine that this set must be 
contained in diag(M n ). 

For k £ N fixed, assume that w(k5) satisfies V(w(kS)) > 0. Given the av- 
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eraging algorithm (1.6.2) defined by the sequence {F(t) \ £ £ Z>o} C J- (a), 
define Fi(fc) = F(k + 1), ..., F 5 (k) = F(k + S). Additionally, define 
F(k) = Fs(k) ■ ■ ■ Fi(k) and note that F(k) £ Tsip), by construction. With 
this notation, note that w(kS + s) = F s (k) ■ ■ ■ F\(k)w{k8) for s £ {1, . . . , 5}. 
Define wm = m ax«e{i,. ..,n} Wi{k5) and w; m = minj e / 1] __„i Wi(k5); by hypoth- 
esis we know w;^/ > w m . Define t/jvf = {i £ {1, . . . , n} | w(k5) = wm} arid 
t^m = {i € {1, . . . ,n} | Wj(k5) = Wm}', by hypothesis we know UM^U m = 0- 
Now, we are ready to use property (ii) in the theorem statement. Since 
({1, . . . , n}, U s6 .n ..n E(F s (k)) contains a globally reachable node and since 
Um and U m are nonempty and disjoint, then Lemma 1.27 implies that there 
exists either 



• (an out-neighbor of Um) an edge (im,Jm) £ E(F s (k5)) with %m £ Um, 
j M £ {l,...,n}\ Um, and s £ {1, . . . ,6}; or 

• (an out-neighbor of U m ) an edge (im,jm) G E(F s (k8)) with i m £ C/ m , 
j m £ {1, . . . , n} \ Um, and s £ {1, . . . , d}. 

Without loss of generality, suppose that an edge {%m-,Jm) exists and let 
so £ {1, . . . , 5} be the first time index for which this happens. We have the 
following two facts. 

First, for every s £ {1, . . . , So — 1}, there does not exist any edge (i, h) 
with i £ Um and h $. Um, and, thus, for all i £ Um', 

n 

Wi (kS + l) = J2( F i(k)hwj(k6) = J2 {Fi{k)) lh w h {k5) 
j=i heu M 



y~] (Fi(k)) ih (k))w M = w M 



heU M 

The same argument can be repeated for F2(k), . . . , F s (k), so that Wi(k5 + 
s) = wm for all i £ Um- 

Second, if i ^ Um at time kS, then Wi(k5+s) < wm for all s £ {1, . . . , sq — 
1}. To see this, we compute 

n n 

Wi (kS + 1) = J2( F ^ k )h w j( kS ) = (Fi(k))nWi(kS) + Y, ( F i( k )k w i( kS ) 

n 

< (F^k^uWiikS) + ( Y, ( F i( k )h)wM 

3=l,3^i 

< awi(kS) + (1 - a)wM < wm, 

where we used the assumption of non-degeneracy with parameter a £ ]0, 1]. 
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The same argument can be repeated for the subsequent multiplications by 
the matrices i*2(&), • • • ,F s (k). 



We finally reach time so and compute 
w lM (M + s ) = ^2(F So (k)) iMJ Wj(k5 + s - 1) 

= ( F s o {k))i M j M w jM {k5 + s -l)+ Yl i^oi^iMjWjikS + so-l) 

II 
< ( F s (k))i M j M W M + Yl ( F l( k ))iM3 w j( k5 + S - 1) < W M ■ 

This implies that w% M ((& + 1)6) < wm, so that %m does not belong to Um at 
time (k + 1)5. That is, the cardinality of Um decreases at least by one after 
(k + 1)5. Since {1, . . . ,n} is finite, after repeating this argument at most 
n — 1 times, we have that Um becomes empty at time (k + n — 1)5. (Here 
we are assuming that the out-neighbor always exists for Um] & n analogous 
argument can be made for the general case.) This is enough to guarantee 
that V(w((k + n)5)) < wm — w m = V(w(k5)). This is what we need to 
conclude that lim dist(w(k5), diag(M)) = 0. In summary, this concludes 

k— >+oo 

the proof of Theorem 1.63. ■ 

We conclude this section by establishing convergence to an individual 
point, rather than a set of points. 



Proof of Proposition 1.67. We adopt the same notation as above, that is, as 
in the proof of Theorem 1.63. Since F{k) G J-s(a), the set of sequence points 
{w(k5) | k g N} belongs to the convex hull of all the components of the initial 
condition, that is, [mini Wi(0),maxj Wi(0)] n . Since [minj u;j(0),maxi Wi(0)] n 
is compact, there exists a convergent subsequence {w(ki6) \ I G N} to a 
point cl n . We also notice that for any ki G N, we have Wi((ki + k)5) G 
[mim. Wi(ki5),ma^iWi(ki5)] n , for all i G {l,...,n} and k G N. Because 
lim w(k[5) = cl n we know that lim [minwi(ki5),m&xwi(k[5)] n = cl n . 

l^+oo I— >+oo i i 

Therefore, any sequence {w((ki + k)5) \ k G N}, for I G N, must converge to 
cl n . This implies that lim w(k5) = cl n . ■ 
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1.8.6 Proofs of Theorems 1.79 and 1.80 

Proof of Theorem 1.79. Let us prove fact (i). Because Trid n (a, b, a) is a real 
symmetric matrix, Trid n (a, b, a) is normal and its 2-induced norm — that is, 
its largest singular value — is equal to the magnitude of its eigenvalue with 
the largest magnitude. Based on this information and on the eigenvalue 
computation in Lemma 1.77, we compute 



Trid n (a, 6,a)|| 2 



17T 

max \b + 2a cos 
te{i,. ..,«.} I \n-f 



< |6| + 2\a\ max 
ie{l,...,n} 



cos 



m 



n+l 



< \b\ +2|a|cos 



n+l 



Because we assumed that |6| + 2|a| = 1 and because cos(— ^j-) < 1 for any n > 
2, the 2-induced norm of Trid n (a, b, a) is strictly less than 1. Additionally, 
for I > 0, we bound from above the magnitude of the curve x, as 



Trid n (a, b, a) xolb < I \b\ + 2\a\ cos 



F0||2- 



In order to have \\x 
llog (\b\ + 2|a|cos 



n+l 



> 



n+l, 

2 < e||xo||2) h is sufficient to require that loge ; 
that is, 

l0g£_1 (1.8.2) 



log[\b\ + 2|a|cos^^ 
The upper bound now follows by noting that, as t — > 0, we have 



1 



1 



+ 0(1). 



log(l-2|o|(l-cosi)) \a\t 2 

Let us now show the lower bound. Assume, without loss of generality, that 
ab > and consider the eigenvalue b + 2acos(^j-j-) of Trid n (a, 6, a). Note 

|6| + 2|a| cos(^q-j-). (If ab < 0, then consider the 
).) For n > 2, define the unit-length vector 



that \b + 2acos Vr _ 
eigenvalue b + 2a cos(^py 



n + 1 



sin 



sin 



n+l 



n+l 



[1.8.3) 



and note that, by Lemma 1.77(i), v n is an eigenvector of Trid„(a, b, a) with 
eigenvalue b + 2acos(^q-j-). The trajectory x with initial condition v„ sat- 



isfies 1 1 a; 



|6| + 2\a\ cos 



n+l 



IvJk, and therefore, it will enter 



B(l n ,e||v n ||2) only when I satisfies equation (1.8.2). This completes the 
proof of fact (i). 
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Next, we prove fact (ii). Clearly, all eigenvalues of the matrix Trid n (a, b, 0) 
are strictly inside the unit disk. For £ > 0, we compute 



Trid n {a,b,0y 



n—l 
= ^(/ n + ^Trid4l,0,0)) £ = 6 ^ j ^^(^'Trid„(l,0,0y, 

because of the nilpotency of Trid„(l, 0, 0). Now, we can bound from above 
the magnitude of the curve x, as 

\\x(£)\\ 2 = WTridni^b^fxoh 

n—l „. 

j=0 j-i j)- 

Here, we used || Trid n (l, 0, 0) J rco H2 < ll^olb and max{ ^j ■,, | j £ {0, . . . , n — 

1}} < £ n ~ l . Therefore, in order to have ||x(£)||2 < ell^olb, it suffices that 
log(e a / fe ) + (n- l)log^ + ^log|6| < loge, that is, 

n-l , „. f-loge 



log £ > 



— log |&| — log |&| 

A sufficient condition for £ — alog£ > /?, for a, (3 > 0, is that £ > 2/3 + 
2amax{l,loga}. For, if £ > 2a, then log£ is bounded from above by the 
line £/2a + logo. Furthermore, the line ^/2a + logo is a lower bound 
for the line {£ — (3) /a if £ > 2/3 + 2a log a. In summary, it is true that 
H^COIh < e ll a; (0)l|2 whenever 

f-loge n-l f n-l 

* > 2-^-j nT + 2— — max <^ 1, log 



log |6| — log |6| 1 -log I 

This completes the proof of the upper bound, that is, fact (ii). 

The proof of fact (iii) is similar to that of fact (i). Because Circ n (a, b, c) is 
circulant, it is also normal and each of its singular values corresponds to an 
eigenvector-eigenvalue pair. From Lemma 1.77(ii) and from the assumption 
a + b + c = 1, it is clear that the eigenvalue corresponding to i = n is equal 
to 1; this is the largest singular value of Circ n (a, b, c) and the corresponding 
eigenvector is l n . We now compute the second largest singular value: 

/i2vr\ , — . . /i2n 

max b + (a + c) cos + y — lie — a) sin 

ie{i,...,n-i} V n J V n 

/ /2tt n \ , ( 2tt 

= 1 — (o + c) 1 1 — cos ( — ) ) + v — 1 (c — a) sin — 
V n / \ n 

Here, || • ||c is the norm in C. Because of the assumptions on a, b, c, the second 
largest singular value is strictly less than 1. In the orthogonal decomposition 
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induced by the eigenvectors of Circ n (a, b, c), we assume that the vector yo 
has a component y ave along the eigenvector l n . For £ > 0, we bound the 
distance of the curve y{£) from y ave ln as 

||?/(^) - yaveln||2 

= ||Circ n (a,6, c)^yo -2/avelnlb = ||Circ„(a, b, c) e (y -^aveOlb 



< 



1 



a + c) 1 — cos 



,2tt, 



7? 



+ V — l(c — a) si 



sin 



2tt 



7) 



1 2/0 - 2/aveln||2- 



This proves that lim£_> +00 y(£) = y ave ln- Also, for a = a + c, (3 = c — a and 
as t — > 0, we have 

+ 0(1). 



log((l-a(l-cost)) 2 + /3 2 sin 2 i) 1/2 ( ° ^ 

Here, /? 2 < a because a,c£ ]0, 1[. From this, one deduces the upper bound 
in (iii). 

Now, consider the eigenvalues A n = b+(a+c) cos (^)+v / — l(c— a) sin ( 2 ^ L ) 
and A n = b+ (a+c) cos ( ra - J + a/^1(c-<2) sin f ra - J of Circ n (a, 6, c), 
and its associated eigenvectors (cf. Lemma 1.77(h)) 



U) 



1 
u 

n-l 



eC 



U) 



1 

n-l 



u,' 



G<C n . 



(1.8.4) 



Note that the vector v n + v n belongs to R n . Moreover, its component 
y ave along the eigenvector l n is zero. The trajectory y with initial condition 

v n + v n satisfies ||y(^)||2 = ||A^v n + A n v n || 2 = |A„|^||v n + v n || 2 , and therefore 
it will enter B(0 n , e||v n + v TO 1 1 2 ) only when 



£> 



loge x 



log 



l-(a + c)(l-cos(f))+ v /r T(c-a)sin(^) 



This completes the proof of fact (iii) . ■ 

Proof of Theorem 1.80. We prove fact (i) and observe that the proof of 
fact (ii) is analogous. Consider the change of coordinates 



x(£) 



y(£) 



x a,ve\'~-J-*-n + "4 







where x' ave (£) G M and y(£) el* . A quick calculation shows that x ave (^) = 
-l^x(£), and the similarity transformation described in equation (1.6.7) 
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implies 

y(£ + 1) = Trid n _!(a, b, a) y(£), and x' ave (£ + 1) = (b + 2a)x' ave (£). 
Therefore, x ave = x' . It is also clear that 



x(e + i)-x ave {e + i)i, 



i\ 





v(* + i) 



( P+ Trid„_i(a,6,a) ^J^^ ^ave(^)ln)- 



Consider the matrix in parentheses determining the trajectory £ i— > (#(■£) — 
x ave (£)l n ). This matrix is symmetric, its singular values are and the singu- 
lar values of Trid„,_i(a, b, a), and its eigenvectors are l n and the eigenvectors 
of Trid„_i(a, b, a) (padded with an extra zero). These facts are sufficient to 
duplicate, step by step, the proof of fact (i) in Theorem 1.79. Therefore, the 
trajectory £ i— > ix{£) — x ave (£)l n ) satisfies the stated properties. ■ 

1.9 EXERCISES 

El.l (Orthogonal and permutation matrices). Prove that 

(i) the set of orthogonal matrices is a group; 

(ii) the set of permutation matrices is a group; and 

(iii) each permutation matrix is orthogonal. 

El. 2 (Doubly stochastic matrices). Show that the set of doubly stochastic matri- 
ces is convex and that it contains the set of permutation matrices. Find in the 
literature as many distinct proofs of Theorem 1.1 as possible. 

Hint: A proof is contained in Horn and Johnson (1985). A second proof method 
is based on methods from combinatorics. 

El. 3 (Circulant matrices). Given two nxn circulant matrices C\ and C2, show that 
the following hold: 

(i) Ci , C\ + C2 and C1C2 are circulant; and 

(ii) C1C2 =C a Ci. 

El. 4 (Spectral radius and oo-induced norm of a row-stochastic matrix). Show 
that the spectral radius and the oo-induced norm of a row-stochastic matrix are 
1. 

Hint: Let A € R. x be stochastic. First, show ||A||oo < 1 by direct algebraic ma- 
nipulation. Second, use the bound in Lemma 1.5 to show that p(A) < 1. Finally, 
conclude the proof by noting that 1 is an eigenvalue of A. 

Hint: An alternative proof that p(A) = 1 is as follows. First, use Gersgorin disks 
Theorem 1.2 to show that spec(^) is contained in the unit disk centered at the 
origin. Second, note that p(A) > 1, since 1 is an eigenvalue of A. 

El. 5 (Positive semidefinite matrix defined by a doubly stochastic and irre- 
ducible matrix). Let A £ M nxn be doubly stochastic and irreducible. Show 
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El. 8 



that the matrix 



In 



is positive semidefinite and that its eigenvalue is simple. 

El. 6 (M-matrices). This exercise summarizes some properties of the so-called M- 
matrices (see Fiedler, 1986). A matrix A £ R nxn is an M-matrix (resp. an Mo- 
matrix) if 

(i) all the off-diagonal elements of A are zero or negative; and 

(ii) there exist a nonnegative matrix C £ M' IX " and k > p(C) (resp. k > 
/9(C)) such that A - kl n - C. 
Show that: 

(i) the matrix B £ I° x " is an M-matrix if 

(a) all the off-diagonal elements of B are zero or negative; and 

(b) there exists a vector v £ R n with positive entries such that Bv 
has positive entries; 

(ii) if A is an Mo-matrix, irreducible and singular, then there exists x £ R n 
with positive entries such that Ax = and rank(A) = n — 1; and 

(iii) if A is an M-matrix, then all eigenvalues of A have positive real parts. 

El. 7 (Decomposition of a stochastic matrix). Consider the matrix 



T = 



Show that: 

(i) T is invertible. 

(ii) For a stochastic matrix F £ R" 
c err £ R 1 ^"- 1 ' such that 

TFT' 1 = 



ri 


-1 













1 


-1 















1 


-] 


i 


1 




1 


1 


L n 


n 




71 


n 



there exist F err £ r("-i)x("-i) and 



F e n 0(„_i) X i 

Cerr ^ 



Moreover, if F is symmetric, then c evv = Oiw 



-i)- 



This exercise establishes two extensions of the LaSalle Invariance Principle. Con- 
sider the same setup and assumptions as in Theorem 1.19, and remove the as- 
sumption that the set W is closed. Prove the following two conclusions. 

(i) Each evolution with initial condition in W approaches a set of the form 
y _1 (c) n(S U(dW \ W)), where c is a real constant and S is the largest 
positively invariant set contained in {w £ W \ V(f(w)) = V(w)}. 



(ii) Each evolution 7 : Z> — > W with imaged) C W approaches a set of the 
form \^ _1 (c) n S, where c is a real constant and S is the largest positively 
invariant set contained in {w £ W \ V(f(w)) = V(w)}. 
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Hint: Regarding part (i), follow the same steps as in the proof of Theorem 1.21 in 
Section 1.8.1 with the following difference: even though the setQ(-f) is not a subset 
of W in general, the set Q(~f) D W is a subset of W and is positively invariant. 

El. 9 (The closed map defined by a finite collection of continuous maps). Let 

/i, . . . , f m : X — > X be continuous functions, where X is a d-dimensional space 
chosen among R d , S d , and the Cartesian products M dl x E> d2 , for some d\ + d^, = d. 
Define the set-valued map T : X =4 X by 

T(x) = {Mx),...J m (x)}. 

Show that T is closed on X. 

El. 10 (Overapproximation Lemma). Prove Lemma 1.24. 

El. 11 (Acyclic digraphs). Let G be an acyclic digraph. Show that: 

(i) G contains at least one sink, that is, a vertex without out-neighbors; 

(ii) G contains at least one source, that is, a vertex without in-neighbors; 
and 

(iii) in an appropriate ordering of the vertices of G, the adjacency matrix A 
is lower-triangular, that is, all its entries above the main diagonal vanish. 
Hint: Order the vertices of G according to their distance to a sink. 

El. 12 (A sufficient condition for a matrix to be primitive). Show that if A € 
K" xrl is nonnegative, irreducible, and has a positive element on the diagonal, then 
A is primitive. Give an example that shows that this condition is sufficient but 
not necessary, that is, find a primitive matrix with no positive element on the 
diagonal. 
Hint: See Exercise El. 23 below for a candidate matrix. 

El. 13 (Condensation digraph). This exercise studies the decomposition of a digraph 
G in its strongly connected components. A subgraph H is a strongly connected 
component of G if H is strongly connected and any other subgraph of G strictly 
containing H is not strongly connected. The condensation digraph of G, denoted 
C(G), is defined as follows: the nodes of C(G) are the strongly connected compo- 
nents of G, and there exists a directed edge in C(G) from node Hi to node H2 if 
and only if there exists a directed edge in G from a node of Hi to a node of H2 ■ 
Show that: 

(i) every condensation digraph is acyclic; 

(ii) a digraph contains a globally reachable node if and only if its condensa- 
tion digraph contains a globally reachable node; and 

(iii) a digraph contains a directed spanning tree if and only if its condensation 
digraph contains a directed spanning tree. 

El. 14 (Incidence matrix). Given a weighted digraph G of order n, choose an arbi- 
trary ordering of its edges. Define the incidence matrix H(G) £ ]]jl E l xn of G by 
specifying that the row of H(G) corresponding to edge (i,j) has an entry 1 in 
column i, an entry —1 in column j, and all other entries equal to zero. Show that 

H{G) T WH(G) = L{G) + L(rev(G)), 

where W £ rI e I x I e I i s the diagonal matrix with aij in the entry corresponding to 
edge (i,j). 
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El. 15 (From digraphs to stochastic matrices and back). Let G be a weighted di- 
graph of order n with adjacency matrix A, out-degree matrix D ont , and Laplacian 
matrix L. Define the following matrices: 

Fi = («I„ + r>out) _1 (K/„ + A), for k € M>o, 

F 2 = I n -eL, foree [0, min{(£> out ) 4 -: 1 |ie {l,...,n}}[. 

Perform the following tasks: 

(i) compute the entries of F\ and F% as a function of the entries of A(G); 

(ii) show that the matrices Fi and Fi are row-stochastic; 

(iii) identify the least restrictive conditions on G such that the matrices F\ 
and F% are doubly stochastic; and 

(iv) determine under what conditions a row-stochastic matrix can be writ- 
ten in the form Fi, or F% for some appropriate digraph (and for some 
appropriate scalars k and e). 

El. 16 (Metropolis— Hastings weights from the theory of Markov chains). Given 
an undirected graph G of order n, define a weighted adjacency matrix A with 
entries 

1 
(Hi - 



' l] l + max{|^)|,|AT0-)|}' 

for (i,j) G E. Perform the following tasks: 

(i) show that the weighted degree of any vertex is strictly smaller than 1; 

(ii) use (i) to justify that e — 1 can be chosen in Exercise El. 15 for the 
construction of the matrix Fi ; and 

(iii) express the exponential convergence factor r exp (F2) as a function of the 
eigenvalues of the Laplacian of G. 

El. 17 (Some properties of products of stochastic matrices). Show the following 
holds: 

(i) If the matrices A\,...,Ak are nonnegative, row-stochastic, or doubly 
stochastic, respectively, then their product A\ ■ ■ ■ Ak is non-negative, row- 
stochastic, or doubly stochastic, respectively. 

(ii) If the nonnegative matrices A\, . . . , Ak have strictly positive diagonal 
elements, then their product A\ ■ ■ ■ Ak has strictly positive diagonal ele- 
ments. 

(iii) Assume that Gi, . . . ,Gk are digraphs associated with the nonnegative 
matrices A\ , . . . , Ak and that these matrices have strictly positive diag- 
onal elements. If the digraph G\ U . . . U Gk is strongly connected, then 
the matrix A\ ■ ■ ■ Ak is irreducible. 

El. 18 (Disagreement function). The quadratic form associated with a symmetric 
matrix B £ R" xn is the function x i— » x T Ex. Given a digraph G of order n, the 
disagreement function 3>g : R" — > M is defined by 

*o(*) = 5 f^aaixj-xi) 2 . (El.l) 
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Show that the following are true: 

(i) the disagreement function is the quadratic form associated with the sym- 
metric positive-semidefinite matrix 

P(G) = i(Do»t(G) + An(G) - A(G) - A(G) T ); 

(ii) P(G) = §(L(G) + L(rev(G))). 

El. 19 (Weight-balanced graphs and connectivity). Let G be a weighted digraph 
and let A be a nonnegative n x n matrix. Show the following statements: 

(i) if G is weight-balanced and contains a globally reachable node, then it is 
strongly connected; 

(ii) if A is doubly stochastic and its associated weighted digraph contains a 
globally reachable node, then its associated weighted digraph is strongly 
connected; and 

(iii) if A is doubly stochastic and a column of X/fc=o ^ k is positive, then 
Y*2Zo A k is positive. 

El. 20 (The Laplacian matrix is positive semidefinite). Without relying on the 
Gersgorin disks Theorem 1.2, show that if the weighted digraph G is undirected, 
then the matrix L(G) is symmetric positive semidefinite. (Note that the proof of 
statement (i) in Theorem 1.37 relies on Gersgorin disks Theorem 1.2). 

El. 21 (Properties of the BFS algorithm). Prove Lemma 1.28. 

El. 22 (LCR algorithm). Consider the following LCR algorithm for leader election: 

(i) Give a UID assignment to each processor for which Q(n 2 ) messages are 
sent; and 

(ii) give a UID assignment to each processor for which only 0(n) messages 
are sent. 

(iii) Show that the average number of messages sent is 0(n\ogn), where the 
average is taken over all possible ordering of the processors on the ring, 
each ordering assumed to be equally likely. 

El. 23 (Properties of a stochastic matrix and its associated digraph). Consider 
the stochastic matrices 



*"5 






1 


1 





1 


1 



and A2 — - 



1 


1 














1 


1 


1 


1 














1 


1 



Define and draw the associated digraphs Gi and G2. Without relying on the 
characterization in Propositions 1.33 and 1.35, perform the following tasks: 

(i) show that the matrices A\ and A2 are irreducible and that the associated 
digraphs Gi and Gi are strongly connected; 

(ii) show that the matrices A\ and Ai are primitive and that the associated 
digraphs G\ and Gi are strongly connected and aperiodic; and 

(iii) show that the averaging algorithm associated with A2 converges in a 
finite number of steps. 
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El. 24 (Compactness of the set of non-degenerate matrices with respect to a 
parameter). Show that, for any a £ ]0, 1], the set of non-degenerate matrices 
with respect to a is compact. 

El. 25 (Laplacian flow: Olfati-Saber and Murray, 2004). Let G be a weighted 
directed graph with a globally reachable node. Define the Laplacian flow on R n 
by 

x — — L(G)x, 
or, equivalently in components, 

Xi — 2_j a ij{ x j — x i)> i e {1, .. .,n}. 

Perform the following tasks: 

(i) Find the equilibrium points of the Laplacian flow. 

(ii) Show that, if G is undirected, then the disagreement function (see Exer- 
cise El. 18) is monotonically non-increasing along the Laplacian flow. 

(iii) Given xo — ((xo)i, • • • , {xo) n ) G R", show that the solution t \— > x(t) of 
the Laplacian flow starting at xq verifies 

min{(:ro)i, ■ ■ • , {xo) n } < Xi(t) < max{(x )i, . . . , (x ) n }, 

for all t £ R>o- Use this fact to deduce that the solution t \— > x(t) is 
bounded. 

(iv) For G undirected, use (i)-(iii) to apply the LaSalle Invariance Principle in 
Theorem 1.20 and show that the solutions of the Laplacian flow converge 
to diag(R n ). 

(v) Find an example G such that, with the notation in Exercise El. 18, the 
symmetric matrix L(G) T P(G) + P(G)L(G) is indefinite. 
Hint: To show that the matrix is indefinite, it suffices to find X\,x 2 £ 
R n such that xi(L(G) T P(G) + P{G)L{G))xi < and x 2 (L{G) T P(G) + 
P{G)L{G))x 2 > 0. 

(vi) Show that the Euler discretization of the Laplacian flow is the Laplacian- 
based averaging algorithm. 

El. 26 (Log— Sum— Exp consensus: Tahbaz-Salehi and Jadbabaie, 2006). Pick 
a 6 R \ {0} and define the function f a : R n -> R by 



U(x) = alog(±-J2 eXja )- 



Show that: 



(i) lim f a (x) = min{a;i, . . . , x n } and lim f a (x) — max{xi, . . . ,x n }; axui 
(ii) lim f a (x) = lim f a (x) = — (xi + ■ • • + x n ). 

Q^ + oo a— *-oo n 

Next, let A £ R nxn be a non-degenerate, doubly stochastic matrix whose associ- 
ated digraph contains a globally reachable node. Given such a matrix A, consider 
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the discrete-time dynamical system 

n 

Wi (£ + 1) = a log ( Y, an e"' W/a ) ■ 



3 = 1 



(iii) Show that w(£) -> / a (io(0))l n as £ -> +oo. 

El. 27 (The theory of Markov chains and random walks on graphs). List as 

many connections as possible between the theory of averaging algorithms discussed 
in Section 1.6.2 and the theory of Markov chains. Some relevant references on 
Markov chains include Scneta (1981) and Lovasz (1993). 

Hint: There is a one-to-one correspondence between averaging algorithms and 
Markov chains. A homogeneous Markov chains corresponds precisely to a time- 
independent averaging algorithm. A reversible Markov chain corresponds precisely 
to a symmetric stochastic matrix. 

El. 28 (Distributed hypothesis testing: Rao and Durrant-Whyte, 1993; Olfati- 
Saber et al., 2006). Let h 1 , for 7 £ V in a finite set F, be a set of alternative 
hypotheses about an uncertain event. Suppose that n nodes take measurements 
Zi, for i 6 {1, ...,n}, related to the event. Assume that each observation is 
conditionally independent of all other observations, given any hypothesis. 

(i) Using Bayes' Theorem and the independence assumption, show that the 
a posteriori probabilities satisfy 

p(h~f\zi,...,Z„) = — - r JJp(Zj|/l 7 ). 

P\Z\, . . . , Z n ) 

(ii) Suppose that the nodes form a undirected unweighted connected syn- 
chronous network with adjacency matrix A. Consider the discrete-time 
dynamical system 



n 



l/(l + d„„t(i)) 



Fix 7 £ F, set 7Ti(0) = p(zi\h 1 ), and show that n(£) 



+00. 



. |jp(zi|/i 7 )l^ 
\ i=1 



(iii) What information does each node need in order to compute the maximum 
a posteriori estimate, that is, to estimate the most likely hypothesis? 
Hint: Can you compute p(zi, . . . , z n ), given knowledge of p(h-,) and of 

As a bibliographic note, the variable 7r,; is referred to as the belief in the seminal 
work by Pearl (1988). 

El. 29 (Bounds on vector norms). Prove Lemma 1.82. 

El. 30 (The "n-bugs problem" and cyclic interactions). The "n-bugs problem" 
related to the pursuit curves from mathematics, inquires about what the paths of 
n bugs, not aligned initially, are when they chase one another. Simple versions of 
the problem (e.g., for three bugs starting at the vertices of an equilateral triangle) 
were studied as early as the nineteenth century. It was in Watton and Kydon 
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(1969) that a general solution for the general n-bugs problem for non-collinear 
initial positions was given. The bugs trace out logarithmic spirals that eventually 
meet at the same point, and it is not necessary that they move with constant 
velocity. Surveys about cyclic pursuit problems are given in the papers in Watton 
and Kydon (1969) and Marshall et al. (2004). Cyclic pursuit, has also been studied 
recently in the multi-agent and control literature; see, for example Bruckstein 
et al. (1991), Marshall et al. (2004), and Smith et al. (2005). In particular, the 
paper Marshall et al. (2004) extends the n-bugs problem to the case of n kinematic 
unicycles evolving in continuous time. 

Consider the simplified scenario of the n-bugs problem placed on a circle of 
radius r and suppose that the bugs' motion is constrained to be on that circle. 
Assume that agents are ordered counterclockwise with identities i £ {1, ...,n}, 
where, for convenience, we identify n + 1 with 1. Denote by Pi{£) = (r,9i(£)) the 
sequence of positions of bug i, initially at Pi{0) = (r,9i(0)). We illustrate two 
scenarios of interest in Figure El.l and we describe them in some detail below. 





(a) (b) 

Figure El.l An illustration of the n-bugs problem. In (a), agent i looks at the position of 
agent i + 1 and moves toward it by an amount proportional to their distance. 
In (b), agent i looks at the position of agents i + 1 and i — 1 and moves 
toward the one which is furthest by an amount proportional to the difference 
between the two distances. In both cases, the proportionality constant is k. 



Cyclic pursuit. Suppose that each bug is chasing the closest counterclockwise 
neighbor (according to the order we have given them on the circle), see 
Figure El. 1(a). In other words, each bug feels an attraction toward the 
closest counterclockwise neighbor that can be described by the equation 

6i(£ + 1) = (1 - k)6 t {£) + ke i+ i(£), £ e Z> , 

where k € [0, 1]. Determine for which values of k the bugs converge to a 
configuration for which dist c (# i+ i, #,;) = dist c (#i, #;_i) for alii £ {l,...,n}. 
Observe that the bugs will approach this equally spaced configuration while 
moving around the circle indefinitely. 

Cyclic balancing. Suppose that each bug makes a compromise between chasing 
its closest counterclockwise neighbor and the closest clockwise neighbor, see 
Figure El. 1(b). In other words, each bug feels an attraction towards the 
closest counterclockwise and clockwise neighbors that can be described by 
the equation 

e l {e + i) = ke t+ i(e) + (i-2k)6i(i) + k8 i - 1 (£), £ez> , 

where k £ [0, 1]. Perform the following two tasks: 
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(i) Determine for which values of k the bugs converge to a configuration 
for which dist c (8 i+ i,6 t ) = dist c (0j,0j_i) for all i £ {1, . . . ,n}. 

(ii) Show that the bugs will approach this equally spaced configuration 
while each of them converges to a stationary position on the circle. 

Hint: Rewrite the cyclic pursuit and cyclic balancing systems in terms of the inter- 
bug distances, that is, in terms of di(l) — dist c (8i+i(l),9i(l)), i £ {1, . . . ,n}, I £ 
Z>o- Find the matrices that describe the linear iterations in these new coordinates. 
Show that the agreement space, that is, the diagonal set in R", is invariant under 
the dynamical systems. Finally, determine which values of k make each system 
converge to the agreement space. Lemma 1.77 might be of use in this regard. 
Regarding part (ii)b), recall that an exponentially decaying sequence is summable. 
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Chapter Two 

Geometric models and optimization 



This chapter presents various geometric objects and geometric optimiza- 
tion problems that have strong connections with motion coordination. Ba- 
sic geometric notions such as polytopes, centers, partitions, and distances 
are ubiquitous in cooperative strategies, coordination tasks, and the inter- 
action of robotic networks with the physical environment. The notion of 
Voronoi partition finds application in diverse areas such as wireless com- 
munications, signal compression, facility location, and mesh optimization. 
Proximity graphs provide a natural way to mathematically model the net- 
work interconnection topology resulting from the agents' sensing and/or 
communication capabilities. Finally, multicenter functions play the role of 
aggregate objective functions in geometric optimization problems. We in- 
troduce these concepts here in preparation for the later chapters. 

The chapter is organized as follows. We begin by presenting basic geo- 
metric constructions. This gives way to introduce the notion of proximity 
graphs along with numerous examples. The next section of the chapter 
presents geometric optimization problems and multicenter functions, pay- 
ing special attention to the characterization of their smoothness properties 
and critical points. We end the chapter with three sections on, respectively, 
bibliographic notes, proofs of the results presented in the chapter, and ex- 
ercises. 

2.1 BASIC GEOMETRIC NOTIONS 

In this section, we gather some classical geometric constructions that will 
be invoked regularly throughout the book. 



2.1.1 Polygons and polytopes 

For p,q 6 M. d , we let ]p,q[= {Xp+{1-X)q | A G ]0, 1[} and \p,q] = {Ap+(1- 
^)q I A €= [0,1]} denote the open segment and closed segment, with extreme 
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points p and q, respectively. We let H PA = {x 6 R d \ \\x — p\\2 < \\x — q\\2} 
denote the closed halfspace of R of points closer (in Euclidean distance) to 
p than to q. In the plane, we often refer to a halfspace as a halfplane. 

As seen in Section 1.2, a set S C R is convex if, for any two points p, q 
in S, the closed segment \p, q] is contained in S. The convex hull of a set 
is the smallest (with respect to the inclusion) convex set that contains it. 
We denote the convex hull of S by co(5). For S = {p±, . . . ,p n } finite, the 
convex hull can be explicitly described as follows: 

n 

co(S) = {Xipi -\ h \ n Pn | A, > and ^ X { = l}. 

Given p and q in M. and a convex closed set Q C M with p £ Q (see 
Figure 2.1), define the from-to-inside function by 



fti(p, q, Q) 



\p, q ]ndQ, 



if q G Q, 

if ? e" Q. 



fti(p,9,Q) 





Figure 2.1 An illustration of the from-to-inside function fti. 



The function fti selects the point in the closed segment [p, q] which is 
at the same time closest to q and inside Q. Note that fti(p, q, Q) depends 
continuously on p and q. 

A polygon is a set in M? whose boundary is the union of a finite number of 
closed segments. A polygon is simple if its boundary, regarded as a curve, 
is not self-intersecting. We will only consider simple polygons. The closed 
segments composing the boundary of a polygon are called edges, and points 
resulting from the pairwise intersection between consecutive edges are called 
vertices. A convex polygon can be written as: 

(i) the convex hull of its set of vertices; or 

(ii) the intersection of halfplanes defined by its edges. 
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Two vertices whose open segment is contained in the interior of the polygon 
define a diagonal. To each vertex of a polygon we associate an interior and 
an exterior angle. A vertex is strictly convex (resp. strictly nonconvex) if its 
interior angle is strictly smaller (resp. greater) than rr radians. A polygon 
is nonconvex if it has at least one strictly concave vertex. The perimeter 
of a polygon is the length of its boundary, that is, the sum of the lengths 
of its edges. A polytope is the generalization of the notion of polygon to 
M. , for d > 3. In this book, we will not consider nonconvex polytopes in 
dimension larger than 2. As for convex polygons, a (convex) polytope in M. 
can be defined as either the convex hull of a finite set of points in IR or the 
bounded intersection of a finite set of halfspaces. Arf-1 face (or a facet) 
of a polytope is the intersection between the polytope and the boundary of 
a closed halfspace that defines the polytope. A d — 2 face is a d — 2 face of 
a facet of the polytope. The faces of dimensions 0, 1, and d — 1 are called 
vertices, edges, and faces, respectively. For a convex polytope Q, we will 
refer to them as Ve(Q), Ed(Q), and F&(Q), respectively. 



2.1.2 Nonconvex geometry 

In this section, we gather some basic notions on nonconvex geometry. We 
consider environments that include nonconvex polygons as a particular case. 

We begin with some visibility notions. Given ScR , two points p,q £ S 
are visible to each other if the closed segment \p, q] is contained in S. The 
visibility set Vi(p; S) is the set of all points in S visible from p. Given r > 0, 
the range-limited visibility set Vid; s k(p; S) = Vi(p; S) (1 B(p, r) is the set of all 
points in S within a distance r and visible from p. The set S is star-shaped if 
there exists p 6 S such that Vi(p; S) = S. The kernel set of S is comprised of 
all the points with this property, that is, kernel(S') = {p £ S | Vi(p; S) = S}. 
Trivially, any convex set is star-shaped. Given 5 £ R>o> the (5-contraction of 
S is the set S$ = {p £ S | dist(p, dS) > 5}. Note that if two points p,q 6 S 
are visible to each other in S$, then any point within distance 8 of p and any 
point within distance 6 of q are visible to each other. Figure 2.2 illustrates 
these visibility notions. 

Next, we introduce various concavity notions. Given Set connected 
and closed, p 6 dS is strictly concave if, for any e 6 M>o, there exist 
Qi,Q2 £ B(p,e)ndS such that [91,^2] <£ S. This definition coincides with 
the notion of strictly concave vertex when the set S is a polygon. A strict 
concavity of S is either an isolated strictly concave point or a concave arc, 
that is, a connected set of strictly concave points. An allowable environment 
S C I 2 is a set that satisfies the following properties: it is closed, simply 
connected, has a finite number of strict concavities, and its boundary can 
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Figure 2.2 An illustration of various visibility notions. The visibility set Vi(pi; S) from p\ 
in S, the visibility set Vi(pi; Ss) from pi in Sg, and the range-limited visibility 
set Vidisk(p2; S) from p2 in S are depicted in light gray. The dashed curve in 
the interior of S corresponds to the boundary of the 5-contraction of S. The 
points p2 and gi are visible to each other in Sg . The points qi and g2 are visible 
to each other in S, but they are not visible to each other in Sg. 



be described by a continuous and piecewise continuously differentiable curve 
which is not differentiable at most at a finite number of points. Figure 2.3 
shows a sample allowable environment. Given an allowable environment S, 
let a point v belonging to a concave arc have the property that the boundary 
of S is continuously differentiable at v. The internal tangent halfplane Hg(v) 
is the closed halfplane whose boundary is tangent to dS at v and whose 
interior does not contain any points of the strict concavity (see Figure 2.3). 



The following result presents an interesting property of allowable environ- 
ments. Its proof is left to the reader. 

Lemma 2.1 (Contraction of allowable environments). Given an al- 
lowable environment S, the 5-contraction Ss is also allowable for sufficiently 
small 8 6 IR>o and does not have isolated strictly concave points. Further- 
more, the boundary of Ss is continuously differentiable at the concavities. 

Lemma 2.1 implies that the internal tangent halfplane is well-defined at 
any strict concavity of the ^-contraction Ss- 

A set S C X is relatively convex in X C M, d if, for any two points p, 
q in S, the shortest curve in X that connects p and q is contained in S. 
Relatively convex sets in R d are just convex sets. The relative convex hull 
of a set S in X is the smallest (with respect to the operation of inclusion) 



97 



"Distributed Control of Robotic Networks" by F. Bullo, J. Cortes and S. Martinez 
Copyright © 2006-2009. Manuscript under contract. This version: March 22, 2009 



DCRN March 22, 2009 



H s (v) 


^ 


• 

Ph 


/ P2 






P3 

• 


pi • \ 
















• P4 


Pe 9 























Figure 2.3 An allowable environment S. The curved portion of the boundary is a concave 
arc. The vertices whose interior angle is 3tt/2 radians are isolated strictly 
concave points. The relative convex hull of {pi, . . . ,Pe,} in S is depicted in 
light gray. Finally, the dashed line represents the boundary of the internal 
tangent halfplane Hs{v) tangent to dS at v. 



relatively convex set in X that contains S (see Figure 2.3). We denote the 
relative convex hull of S in X by rco(S';X). The (relative) perimeter of S 
in X is the length of the shortest measurable closed curve contained in X 
that encloses S. 



2.1.3 Geometric centers 

Let X = R d , X = S d or X = R dl x S d2 , d = d 1 + d 2 . Recall our convention 
(cf., Section 1.1.2) that, unless otherwise noted, W* is endowed with the 
Euclidean distance, S rf is endowed with the geodesic distance, and M. dl x S^ 2 
is endowed with the Cartesian product distance (dist2, dist 9 ). 

The circumcenter of a bounded set S <Z X, denoted by CC(«S), is the cen- 
ter of the closed ball of minimum radius that contains S. The circumradius 
of S, denoted by CR(S'), is the radius of this ball 1 . The circumcenter is 
always unique. 

The computation of the circumcenter and the circumradius of a polytope 
Q C W* is a strictly convex problem and, in particular, a quadratically 
constrained linear program in p (the center) and r (the radius). It consists 
of minimizing the radius r of the ball centered at p subject to the constraints 
that the distance between q and each of the polygon vertices is smaller than 



1 Note that the definition of circumcenter given here is in general different from the classical 
notion of circumcenter of a triangle, that is, the center of the circle passing through the three 
vertices of the triangle. 
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or equal to r. Formally, the problem can be expressed as 



minimize r 



subject to \\q — p\\ 2 < r , for all q G Ve(Q). 



(2.1.1) 



Next, we summarize some useful properties of the circumcenter in Euclidean 
space; see Exercise E2.1 for their proofs. In the following result, for S G 
F(R d ) with d = 1, we let Ve(co(S)) denote the set of extreme points of the 
interval co(S'). 

Lemma 2.2 (Properties of the circumcenter in Euclidean space). 

Let S = {pi, . . . ,p n } G F(R d ) with n > 2. The following properties hold: 

(i) CC(5) G co{S) \ Ve(co(5))/ and 

(ii) ifp£ co(5) \ {CC(5)} and r G 
then ]p, C< 
q G co(5). 



>0 are such that S C B(p,r), 
then ]p, CC(5)[ has a nonempty intersection with B(^-^-, |) for all 





Figure 2.4 The circumcenter and circumradius (left), and incenter and inradius (right) of 
a convex polygon. 

Given X = R d , X = S d or X = R dl x S d % d = d\ + d 2 , the incenter, 
or Chebyshev center of a compact set S C X, denoted by 10(5), is the set 
containing the centers of all closed balls of maximum radius contained in S. 
The inradius of S, denoted by IR(5), is the common radius of any of these 
balls. 

The computation of the incenter and the inradius of a polytope Q C R d is 
a convex problem and, in particular, a linear program in p and r. It consists 
of maximizing the radius r of the ball centered at p subject to the constraints 
that the distance between p and each of the polytope facets is greater than 
or equal to r. Formally, the problem can be expressed as follows. For each 
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/ £ Fa(<5), select a point qf E Q belonging to /. Then, we set 

maximize r , 

subject to (qj — p) ■ n out > r , for all / G Fa(Q), (2.1.2) 

where n out denotes the normal to the face / pointing toward the exterior of 
the polytope. The incenter of a polytope is not necessarily unique (consider, 
for instance, the case of a rectangle). 

In Euclidean space, X = R , we refer to a bounded measurable function 
(ft : R — > R>o as a density on R . The (generalized) area and the centroid 
(also called center of mass) of a bounded measurable set S C R d with respect 
to (ft, denoted by A < j > (S) and CM^(S') respectively, are given by 

A (5) = / <ft(q)dq, CM^S) = -±- f q(ft(q)dq. 

Js A 4>\ b ) Js 

When the function (ft that is being used is clear from the context, we simply 
refer to the area and the centroid of S. The centroid can alternatively be 
defined as follows. Define the polar moment of inertia of S about p £ S by 

J<j,(S,p) = / \\q - p\\l<ft(q)dq. 
Js 

Then, the centroid of S is precisely the point p £ S that minimizes the polar 
moment of inertia of S about p. This can be easily seen from the Parallel 
Axis Theorem (Hibbeler, 2006), which states that 

W*0 = J*(S, CM^(S)) + A^S)\\p - CM (5)|||. 



Remark 2.3 (Computation of geometric centers in the plane). The 

circumcenter, incenter, and centroid of a polygon can be computed in several 
ways. A simple procedure to compute the circumcenter consists of enumer- 
ating all pairs and triplets of vertices of the polygon, computing the centers 
and radiuses of the balls passing through them, and selecting the ball with 
the smallest radius that encloses the polygon. An alternative, more effi- 
cient, way of computing the circumcenter is to use the formulation (2.1.1). 
A convex quadratically constrained linear program is a particular case of a 
semidefinite-quadratic-linear program (SQLP). Several freely available nu- 
merical packages exist to solve SQLP problems; for example, SDPT3 (Tu- 
tuncu et al., 2003). The computation of the incenter set of a polygon can 
be performed via linear programming using the formulation (2.1.2). Finally, 
the centroid of a polygon can be computed with any numerical routine that 
accurately approximates the integral of a function over a planar domain. • 
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2.1.4 Voronoi and range-limited Voronoi partitions 

A partition of a set S is a subdivision of S into connected subsets that are 
disjoint except for their boundary. Formally, a partition of S is a collection 
of closed connected sets {W±, . . . , W m } C P(<S) that verify 

S = U™ 1 Wi and int(Wj) n int(W fc ) = 0, 

for j, fc £ {1, . . . , m}. 

Definition 2.4 (Voronoi partition). Given a distance function dist : 
X x X — > M>o, a set 5 C X and n distinct points P = {pi, . . . ,p n } in 5, 
the Voronoi partition of 5 generated by V is the collection of sets V(V) = 
{Vi(V), • • • , V n (V)} C P(5) defined by, for each i&{l,...,n}, 

Vi(V) = {q e 5 | dist(g,pj) < dist(g,pj)> for all Pj S P \ fe}}. • 

In other words, Vi(P) is the set of the points of 5 that are closer to pi 
than to any of the other points in V . We refer to Vi(V) as the Voronoi cell 
of pi. Unless explicitly noted otherwise, we compute the Voronoi partition 
according to the following conventions: 

• for X = M. , with respect to the Euclidean distance; 

• for X = S d , with respect to the geodesic distance; and 

• for X = M. dl x S^ 2 , d\ + d,2 = d, with respect to the Cartesian product 
distance determined by dist2 on M. dl and dist 9 on S^ 2 . 

Figure 2.5 shows an example of the Voronoi partition of the circle gener- 
ated by five points. In the Euclidean case, the Voronoi cell of pi is equal to 
the intersection of half-spaces determined by pi and the other locations in 
V, and as such it is a convex polytope. The left plot in Figure 2.6 shows 
an example of the Voronoi partition of a convex polygon generated by 40 
points. 

Definition 2.5 (r-limited Voronoi partition). Given a distance function 
dist : X x X — > M>o, a set S C X, n distinct points V = {p±, . . . ,p n } in S, 
and a positive real number r £ M>o, the r-limited Voronoi partition inside 
S generated by V is the collection of sets V r {V) = {Vi <r (V), . . . , V ntr (V)} C 
P(5) defined by 

v i ,r(r) = v i (r)nB(p i ,r), ie{i,...,n}. 

Note that the r-limited Voronoi partition inside S is precisely the Voronoi 
partition of the set U" =1 B(pi, r)(lS. We will refer to Vi ir (V) as the r-limited 
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Figure 2.5 Voronoi partition of the circle generated by five points. The dashed segments 
correspond to the Voronoi cells of each individual point. 





Figure 2.6 Voronoi partition of a convex polygon (left) and r-limited Voronoi partition 
inside a convex polygon (right) generated by 40 points. 



Voronoi cell oipi. The right-hand plot in Figure 2.6 shows an example of the 
r-limited Voronoi partition inside a convex polygon generated by 40 points. 

Let X = R d , X = S d or X = R dl xS d2 , d = d 1 + d 2 . Given a density (p 
on X, a set of n distinct points V = {p\, ■ ■ ■ ,p n } hi S C X is: 

(i) A centroidal Voronoi configuration if each point is the centroid of 
its own Voronoi cell, that is, pi = CM^V^'P)) . 

(ii) An r-limited centroidal Voronoi configuration, for r £ M>o, if each 
point is the centroid of its own r-limited Voronoi cell, that is, pi = 
CMj)(Vi jr (V)). If r > diam(S'), then an r-limited centroidal Voronoi 
configuration is a centroidal Voronoi configuration. 

(iii) A circumcenter Voronoi configuration if each point is the circum- 
center of its own Voronoi cell, that is, pi = CC(Vi(V)). 

(iv) An incenter Voronoi configuration if each point is an incenter of its 
own Voronoi cell, that is, p% £ IC(Vi(V)). 
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Figure 2.7 illustrates of the various notions of center Voronoi configurations. 




Figure 2.7 From left to right, centroidal, r-limited centroidal, circumcenter, and incenter 
Voronoi configurations composed by f6 points in a convex polygon. Darker 
blue-colored areas correspond to higher values of the density <f>. 



2.2 PROXIMITY GRAPHS 

Roughly speaking, a proximity graph is a graph whose vertex set is a set of 
distinct points and whose edge set is a function of the relative locations of 
the point set. Proximity graphs appear in computational geometry. In this 
section, we study this important notion in detail following the presentation 
by Cortes et al. (2005). 

Definition 2.6 (Proximity graph). Assume that X is a d-dimensional 
space chosen among R , S , and the Cartesian products Mr 1 x § 2 , for some 
d\ + di = d. For a set S C X, let G(S) be the set of all undirected graphs 
whose vertex set is an element of F(5). A proximity graph Q : ¥(S) — > G(S) 
associates to a set of distinct points V = {p±, . . . ,p n } C S an undirected 
graph with vertex set V and whose edge set is given by £g{V) C {{p, q) £ 
V xV\p^q}. • 

Note that in a proximity graph a point cannot be its own neighbor. From 
this definition, we observe that the distinguishing feature of proximity graphs 
is that their edge sets change with the location of their vertices. It is also 
possible to define proximity graphs that associate to each point set a digraph, 
but we will not consider them here. 

Examples of proximity graphs on X, where we recall that dist = dist2 if 
X = R d , dist = dist 9 if X = S d , and dist = (dist 2 , dist 9 ) if X = R dl x S rf % 
include the following: 

(i) The complete graph Q cmp \t where any two points are neighbors. 
When convenient, we may view the complete graph as weighted 
by assigning the weight dist(j?i, Pj) to the edge (pi,Pj) £ £g cmpH ('P)- 

(ii) The r-disk graph Gdisk{ r ), f° r r £ R>0i where two points are neigh- 
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bors if they are located within a distance r, that is, (pi,Pj) G 
£ G***(r)(P) # dist(pi,pj) < r. 

(iii) The Delaunay graph Qd, where two points are neighbors if their 
corresponding Voronoi cells intersect, that is, {pi,Pj) G £g D (V) if 

Vi(v) nVj(v) ^ ®. 

(iv) The r-limited Delaunay graph ^ldC 7 ")) f° r r ^ ^>o 5 where two points 
are neighbors if their corresponding ^-limited Voronoi cells intersect, 
that is, (pi, Pj ) G £g LD{r) (V) if V^(V)nV jr .(V) / 0. 

(v) The relative neighborhood graph <5rn, where two points are neigh- 
bors if their associated open lune (cf. Section 1.1.2) does not contain 
any point in V, that is, (jPi,Pj) G £g RN (V) if, for all pk G V, k {i, j} 

Pk B(pi,dwt(pi,pj))r\B(pj,dwt(pi,pj)). 
Figure 2.8 shows examples of these proximity graphs in the plane. 




( a ) Scmplt 



(b) SdiskM 



(c) Sd 




(d) SldW 



(e) Gm 



Figure 2.8 Proximity graphs in R 2 . From left to right, in the first row, complete, r- 
disk, and Delaunay, and in the second row, r-limited Delaunay and relative 
neighborhood for a set of 15 points. When appropriate, the geometric objects 
determining the edge relationship are plotted in lighter gray. 



Additional examples of proximity graphs in the Euclidean space include 
the following: 
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vi 



The Gabriel graph Qq, where two points are neighbors if the ball 
centered at their midpoint and passing through both of them does 
not contain any point in V, that is, (pi,Pj) G £g a ('P) if Vk 
B(^±El, dist(p„ Pj ) ^ for all p k G V. 



vn 



(viii) 



(ix) 



to 



2 ' 2 

The r-oo-disk graph Goo-disk{ r )i f° r r £ ^>0i where two points are 
neighbors if they are located within L°°-distance r, that is, (pi,Pj) G 
£0oo-di.k(r)(? ? ) if dist 00 (p i ,pj) < r. 

The Euclidean minimum spanning tree of a proximity graph (/, de- 
noted by <?EMST,g , that assigns to each V a minimum-weight span- 
ning tree (cf., Section 1.4.4.4) of G(V) with weighted adjacency ma- 
trix dij = \\pi—pj\\2, for (j?i,Pj) E £g(V). If Q(V) is not connected, 
then ^EMST,g('P) is the union of Euclidean minimum spanning trees 
of its connected components. When Q is the complete graph, we 
simply denote the Euclidean minimum spanning tree by <?emst- 

the visibility graph G v is,Q i n an allowable environment Q in M 2 , 
where two points are neighbors if they are visible to each other, 
that is, {pi,Pj) G £g vlsQ {V) if the closed segment [pi,Pj] from pi to 
Pj is contained in Q. 

The range-limited visibility graph G v is-disk,Q in an allowable environ- 
ment Q in R 2 , where two points are neighbors if they are visible to 
each other and their distance is no more than r, that is, (pi,Pj) G 



Sc 



t (P) if ( Pi , Pj ) G £g^ Q {V) and ( Pi , Pj ) G £g disk{r) (V). 



Figure 2.9 shows examples of these proximity graphs in the plane; Fig- 
ure 2.10 shows examples of these proximity graphs in a planar nonconvex 
environment; and Figure 2.11 shows example graphs in three-dimensions. 




(a) g G 



(c) 0EMST 



Figure 2.9 Proximity graphs in K 2 . From left to right, Gabriel graph, r-oo-disk graph, and 
Euclidean minimum spanning tree for 15 points. In two images, the geometric 
objects determining the edge relationship are plotted in light gray. 



As for standard graphs, let us alternatively describe the edge set by means 
of the sets of neighbors of the individual graph vertices. To each proximity 
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1 f/ I 

rf' 




(») 5y is ,Q 



(b) <?vis-disk,Q 



Figure 2.10 The visibility and range-limited visibility graphs for 8 agents in an allowable 
environment. The geometric objects determining the edge relationship are 
plotted in light gray. 




(a) SdiskM 



(b) G G 



(c) Srn 



Figure 2.11 Proximity graphs in K 3 . From left to right, r-disk, relative neighborhood, 
and Gabriel graphs for a set of 25 points. 



graph Q, each pel and each V = {pi, . . . ,p n } e F(X), we associate the 
set of neighbors map Mg : X x ¥(X) —> ¥(X) defined by 

^0(P,V) = {q£V\(p,q)£ Sg(VU{p})}. 

Typically, p is a point in V, but the definition is well-posed for any p £ 
X . Under the assumption that V does not contain repeated elements, the 
definition will not lead to counterintuitive interpretations later. Given p £ 
X, it is convenient to define the map Mg p : ¥(X) — » ¥(X) by Mg P (V) = 
Mg(p,V). 

A proximity graph Q\ is a subgraph of a proximity graph £2 , denoted t/i C 
Q2, if Gi(V) is a subgraph of Q2CP) for all T 3 £ F(X). The following result, 
whose proof is given in Section 2.5.1, summarizes the subgraph relationships 
in the Euclidean case among the various proximity graphs introduced above. 
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Theorem 2.7 (Subgraph relationships among some standard prox- 
imity graphs on R ). For r G R>o, the following statements hold: 

(i) <?emst C £rn C^gC Gt>; and 
(ii) QG^Gd\sk{r) C t? LD (r) C GD^Gdisk(r). 

Note that the inclusion (? LD (r) C GD^Gdisk( r ) is hi general strict; this 
counterintuitive fact is discussed in Exercise E2.3. Additionally, since £?emst 
is by definition connected, Theorem 2.7(i) implies that Grn, Gg, and Gd are 
connected. The connectivity properties of £disk( r ) are characterized in the 
following result. 

Theorem 2.8 (Connectivity properties of some standard proximity 
graphs on R ). For r G R>o, the following statements hold: 

(i) <?emst C Gd\sk(r) if and only if Gdisk(r) is connected; and 

(ii) ^EMSTnt; disk (r), G^N^Gdisk{r), GG^Gdisk{r) andGu){r) have the 
same connected components as Gdiakir) (i-e., for all point sets V G 
F(R ), all graphs have the same number of connected components 
consisting of the same vertices). 

The proof of this theorem is given in Section 2.5.1. Note that in Theo- 
rem 2.8, fact (ii) implies (i). 



2.2.1 Spatially distributed proximity graphs 

We now consider the following loosely stated question: When does a given 
proximity graph encode sufficient information to compute another proximity 
graph? For instance, if a node knows the position of its neighbors in the 
complete graph (i.e., of every other node in the graph), then it is clear that 
the node can compute its neighbors with respect to any proximity graph. 
Let us formalize this idea. A proximity graph G\ is spatially distributed over 
a proximity graph G2 if, for all p G V, 

^ 1 , P (P)=A^ liP (AAg 2 , p (P)), 

that is, any node informed about the location of its neighbors with respect 
to Gi can compute its set of neighbors with respect to Q\. 

Clearly, any proximity graph is spatially distributed over the complete 
graph. It is straightforward to deduce that if G\ is spatially distributed over 
G2, then G\ is a subgraph of Gi- The converse is in general not true. For 
instance, Gd H Gdisk{r) is a subgraph of <?disk(0, but Gd H Gdisk{r) is not 
spatially distributed over Gdisk(r); see Exercise E2.4. 
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The following result identifies proximity graphs which are spatially dis- 
tributed over Gdisk(r)- 

Proposition 2.9 (Spatially distributed graphs over the disk graph). 

The proximity graphs Gkn D Gdisk(r), Gg H Gdisk(r), and £ld(?") are spatially 
distributed over Gdisk(r)- 

Remark 2.10 (Computation of the Delaunay graph over the r-disk 
graph). In general, for a fixed r £ M>o, Gb is not spatially distributed over 
Gdisk( r )- However, for a given V £ ¥(X), it is always possible find r such 
that Gd(P) is spatially distributed over Gdisk( r )('P)- This is a consequence 
of the following observations. Given V £ F(X), define the convex sets 

W(pi,r) = B(pi,r)n (n||p._ p .||< r H p . tP .), i £ {l,...,n}, 

where we recall that H PtX is the half-space of points q in R ' with the property 
that \\q — p\\% < \\q — x\\2- Note that the intersection B(pi, r) n V{ is a subset 
of W(pi,r). Provided that r is twice as large as the maximum distance 
between pi and the vertices of W(pi,r), then all Delaunay neighbors of pi 
are within distance r from p^. Equivalently, the half-space H PuP determined 
by pi and a point p outside B(pi,r) does not intersect W(pi,r). Therefore, 
the equality Vi = W(pi,r) holds. For node i £ {l,...,n}, the minimum 
adequate radius is then 

fi.min = 2max{\\pi - q\\ 2 \ q £ W{pu r hinin )}. 

The minimum adequate radius across the overall network is then r m ; n = 
maXj 6 r lj n i ri, m m- The algorithm presented in Cortes et al. (2004) builds 
on these observations to compute the Voronoi partition of a bounded set 
generated by a pointset in a distributed way. • 



2.2.2 The locally cliqueless graph of a proximity graph 

Given a proximity graph, it is sometimes useful to construct another prox- 
imity graph that has fewer edges and the same number of connected compo- 
nents. This is certainly the case when optimizing multi-agent cost functions 
in which the proximity graph edges describe pairwise constraints between 
agents. Additionally, the construction of the new proximity graph should 
be spatially distributed over the original proximity graph. Here, we present 
the notion of locally cliqueless graph of a proximity graph. 

Let G be a proximity graph in the Euclidean space. The locally cliqueless 
graph G\ c .g of G is the proximity graph defined by: (pi,Pj) £ ^g lcS (P) if 
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Figure 2.12 Locally cliqueless graph Gic.g vlB Q of the visibility graph G v is,Q for the node 
configuration shown in Figure 2.9(d). 



(PuPj) ££g(P) and 

(Pi,Pj) ££g EMST (V), 

for any maximal clique V 1 of (pi,Pj) in £/. Figure 2.12 shows an illustration 
of this notion. The properties of this construction are summarized in the 
following result; for the proof, see Ganguli et al. (2009). 

Theorem 2.11 (Properties of the locally cliqueless graph). Let Q be 

a proximity graph in the Euclidean space. Then, the following statements 
hold: 

(i) <?EMST,g C Qi c g C Q; 

(H) G\c,g has the same connected components as Q ; and 

(Hi) for Q = £disk(0, V [ S ,Q, and t? v is-disk,Q , where r 6 M>o and Q is an 
allowable environment, Q\ c ,g is spatially distributed over Q . 

In general, the inclusions in Theorem 2.11(i) are strict. 



2.2.3 Proximity graphs over tuples of points 

The notion of proximity graph is defined for sets of distinct points V = 
{pi, . . . ,p n }. However, we will be interested in considering tuples of elements 
of X of the form P = (pi, . . . ,p n ), where pi corresponds to the position of 
an agent i of a robotic network. In principle, note that the tuple P might 
contain coincident points. In order to reconcile this mismatch between sets 
and tuples, we will do the following. 

Let if : X n — > ¥(X) be the natural immersion of X n into ¥(X), that 
is, iw(P) is the point set that contains only the distinct points in P = 
(pi, . . . ,p n ). Note that if is invariant under permutations of its arguments 
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and that the cardinality of iw(pi, ■ ■ ■ ,Pn) is in general less than or equal to 
n. In what follows, V = iw(P) will always denote the point set associated 
to P G X n . Using the natural inclusion, the notion of proximity graphs can 
be naturally extended as follows: given Q, we define (with a slight abuse of 
notation) 

g = g i ¥ :x n ^G(x). 

Additionally, we define the set of neighbors map Mg : X x X n — > ¥(X) by 
J\fg(p, (pi, . . . ,p n )) = J\fg{p,i ¥ (pi, ■ ■ -,Pn))- 

According to this definition, coincident points in the tuple (p\, . . . ,p n ) will 
have the same set of neighbors. As before, it is convenient to define the 
shorthand notation Mg >p : X n -> ¥(X), Mg, p (P) = Mg{p, P) for pel. 

2.2.4 Spatially distributed maps 

Given a set Y and a proximity graph Q, a map T : X n — > Y n is spatially 
distributed over Q if there exists a map T : X x ¥(X) — > Y , with the property 
that, for all (pi,... ,p n ) G X ra and for all j G {1, . . . , n}, 

^•(pi, . . . ,p„) = f(p j ,J\fg :P .(p 1 , . . . ,p„)), 

where Tj denotes the jth component of T. In other words, the jth compo- 
nent of a spatially distributed map at (pi, . . . , p n ) can be computed with only 
knowledge of the vertex pj and the neighboring vertices in the undirected 
graph Q(P). 

When studying coordination tasks and coordination algorithms, it will be 
relevant to characterize the spatially distributed features of functions, vector 
fields, and set-valued maps with respect to suitable proximity graphs. 

Remark 2.12 (Relationship with the notion of spatially distributed 
graphs). Note that the proximity graph Q\ is spatially distributed over the 
proximity graph t/ 2 if and only if the map 

P e x n ~ (Mg uPl (P), . . . ,Mg uPn (P)) e ¥(X) n 
is spatially distributed over Qi- • 

2.3 GEOMETRIC OPTIMIZATION PROBLEMS AND 
MULTICENTER FUNCTIONS 

In this section we consider various interesting geometric optimization prob- 
lems. By geometric optimization, we mean an optimization problem induced 
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by a collection of geometric objects (see Boltyanski et al., 1999). We shall 
pay particular attention to facility location problems, in which service sites 
are spatially allocated to fulfill a particular request. 



2.3.1 Expected-value multicenter functions 

Let S C M. d be a bounded environment of interest, and consider a density 
function cp '■ R d —> R>o- For the discussion of this section, only the value of 
cf> restricted to S is of interest. One can regard <fi as a function measuring the 
probability that some event takes place over the environment. The larger 
the value of (ft(q), the more important the location q is. We refer to a non- 
increasing and piecewise continuously differentiable function / : M>o — > K, 
possibly with finite jump discontinuities, as a performance. Performance 
functions describe the utility of placing a node at a certain distance from 
a location in the environment. The smaller the distance, the larger the 
value of /, that is, the better the performance. For instance, in servicing 
problems, performance functions can encode the travel time or the energy 
expenditure required to service a specific destination. In sensing problems, 
performance functions can encode the signal-to-noise ratio between a source 
with an unknown location and a sensor attempting to locate it. 

Given a bounded measurable set S C R , a density function (p, and a 
performance function /, let us consider the expected value of the coverage 
over any point in S provided by a set of points pi,...,p n . Formally, we 
define the expected-value multicenter function "H exp : S n — > K by 

H exp (pi,...,Pn)= max f(\\q-pih)(f>(q)dq. (2.3.1) 

J S l£{l,...,n} 

The definition of Ti ex p can be interpreted as follows: for each location q £ S, 
consider the best coverage of q among those provided by each of the nodes 
pi, . . . ,p n , which corresponds to the value maXj G { lj __ n \ f(\\q — jo^ 1 1 2 ) - Then, 
evaluate the performance by the importance 4>{q) of the location q. Finally, 
sum the resulting quantity over all the locations of the environment S, to 
obtain TC exp (pi, ■ ■ ■ ,Pn) as a measure of the overall coverage provided by 
Pi,...,p n - 

Given the meaning of Ti ex p, we seek to solve the following geometric op- 
timization problem: 

maximize H exp (pi,... ,p n ), (2.3.2) 

that is, we seek to determine a set of configurations pi, ■ ■ ■ ,p n that maximize 
the value of the multicenter function 7i ex p. An equivalent formulation of this 
problem is referred to as a continuous p-median problem in the literature 
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on facility location (see, e.g., Drezner, 1995). In our discussion, we will 
pay special attention to the case when n = 1, which we term the 1-center 
problem. For the purpose of solving (2.3.2), note that we can assume that 
the performance function satisfies /(0) = 0. This can be done without loss 
of generality, since for any ceK, one has 

/ max (f(\\q-pi\\2) + c)(f)(q)dq = He X p(pi,-.-,Pn) +cA (/) (S). 
J s ie{i,...,n} 

The expected- value multicenter function can be alternatively described in 
terms of the Voronoi partition of S generated by V = {p±, . . . ,p n }. Let us 
define the set 

Scoinc = {(Pl> ■ ■ • >Pn) € (M d ) n I Pi = Pj for some i ¥= j}, 

consisting of tuples of n points, where some of them are repeated. Then, for 
(pi, . . . ,p n ) E S n \ cS C oinc, one has 

n „ 

H eX p(pi,...,Pn) = y2 f(\\q-Pih)<t>(q)dq. (2.3.3) 

l=1 Jvm 

This expression of 7i exp is appealing because it clearly shows the result of 
the overall coverage of the environment as the aggregate contribution of all 
individual nodes. If (pi, . . . ,p n ) 6 5 C oinc, then a similar decomposition of 
Hexp can be written in terms of the distinct points V = «f(pi, • • • ,Pn)- 

Inspired by the expression (2.3.3), let us define a more general version 
of the expected- value multicenter function. Given (pi,... ,p n ) £ S n and a 
partition {Wi, . . . , W n } C P(S) of S, let 

n „ 

n exp (pi,...,p n ,Wi,...,w n ) = J2 f(h-Pih)ttq)dq- (2.3.4) 

i=l J w> 

Notice that H exp (pi, . . . ,p n ) = H exp (pi, . . . ,p n ,Vi(V), . . . ,V n (V)), for all 
(pi, . . . ,p n ) £ S™\ 5 C oinc- Moreover, one can establish the following opti- 
mality result (see Du et al., 1999). 

Proposition 2.13 (W e xp-°ptimality of the Voronoi partition). Let 

V = {pi,...,p n } £ ¥(S). For any performance function f and for any 
partition {Wi, . . . , W n } C P(5) of S, 

H exp (pi, ...,p n , Vi(V), ..., V n (V)) > H exp (pi, ...,p n ,W 1} ..., W n ), 

and the inequality is strict if any set in {Wi, . . . , W n } differs from the cor- 
responding set in {Vi(V), ■ . . , V n (V)} by a set of positive measure. In other 
words, the Voronoi partition V(V) is optimal for 7i exp among all partitions 
ofS. 
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Proof. Assume that, for % ^ j G {1, . . . , n}, the set int(Wi) n mt(Vj(V)) has 
strictly positive measure. For all q G mt(Wi) D mt(Vj (V)) , we know that 
ll?-Pi||2 > Ik-Pjlb- Because /is non-increasing, fiWq-pih) < f(\\q-Pjh) 
and, since int(Wi) (lmt(Vj (V)) has strictly positive measure, 



f(\\q-Pih)<t>(q)dq< / f(h-Pjh)<t>(q)dq. 

int(Wi) n int(V; (7>)) ^int(Wi) n int(Vj (P)) 

Therefore, we deduce 

/ /(lk-wl|2)^(«)dg< V / /(lk-Pj||2)<^(g)dg, 

JWi j=1 Jw i nv j (V) 

and the statements follow. ■ 



Different performance functions lead to different expected-value multicen- 
ter functions. Let us examine some important cases. 

Distortion problem: Consider the performance function f(x) = —x 2 . 
Then, on S n \ 5 co i nc , the expected-value multicenter function takes 
the form 

n „ n 

W d ist(pi, • • ■ ,Pn) = ~ T2 / Ik - Pi\\l^{q)dq = - V 3<}>{Vi(V),Pi), 

where recall that J^(W,p) denotes the polar moment of inertia of the 
set W about the point p. In signal compression —Tidist is referred to 
as the distortion function and is relevant in many disciplines including 
vector quantization, signal compression, and numerical integration (see 
Gray and Neuhoff, 1998; Du et al., 1999). Here, distortion refers to the 
average deformation (weighted by the density </>) caused by reproduc- 
ing q G S with the location pi in V = {pi, . . . ,p n } such that q G ViiV). 
It is interesting to note that 



Hdistipi, ■ ■ ■ ,Pn,Wi, . . . ,W n ) = -^2^4,{W l ,p i ) 

1=1 

n n 

= -J2MWi,CM^Wi)) - J2M W i)\\Pi - CM^(Wi)||l, (2-3.5) 

i=l i=l 

where in the last equality we have used the Parallel Axis Theorem (Hi- 
bbeler, 2006). Note that the first term only depends on the partition 
of S, whereas the second term also depends on the location of the 
points. The following result is a consequence of this observation. 
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Proposition 2.14 (7^dist - °ptimality of centroid locations). Let 

{Wi, . . . , W n } C P(5) be a partition of S. Then, for any set points 

V = { Pl ,..., Pn }eF(S), 

Hdfat(CM*(Wi), . . . , CM^W n ), W h ..., W n ) 

> Hdistipi, . ■ ■ ,Pn,Wi, . . . ,W n ), 

and the inequality is strict if there exists i £ {1, . . . , n} for which Wi 
has non-vanishing area and pi ^ CM^iWi). In other words, the cen- 
troid locations CM < *(Wi), . . . , CM^Wn) are optimal for "H^ist among 
all configurations in S. 

A consequence of this result is that for the 1-center problem, that 
is, when n = 1, the node location that optimizes p \— > Tidist(p) = 
— J<p(S,p) is the centroid of the set S, denoted by CM^,(5). 

Area problem: For a £ K>o 5 consider the performance function f(x) = 
lr 0a i(a;), that is, the indicator function of the closed interval [0, a]. 
Then, the expected-value multicenter function takes the form 

n „ 

ftarea,a(Pl, • • • ,Pn) = V / l[0,a](l|S ~ Pih)<ft{q)dq 

n „ 

= E / - ^dq 

i=1 Jv t (P)nB(p i ,a) 

it 
= V A^ViiV) n B(jh, a)) = A^ =1 B( Pl , a)), 



i=l 



that is, it corresponds to the area, measured according to (ft, covered by 
the union of the n balls B{p\, a), . . . , B(p n , a). Exercise E2.5 discusses 
the 1-center area problem. 

Mixed distortion-area problem: For a £ R>o and b < —a 2 , consider 
the performance function f(x) = — x 2 l[ 0)a ](x) + b ■ l] a ,+oo[( x )- Then, 
on S n \ 5 co i nc , the expected-value multicenter function takes the form 

it 

T-CdM-a,r ea ,,a,b(pi, ■ ■ ■ ,Pn) = ~ }, J </>(Vi,a(P) , Pi) + b A (jy (Q\\J^ =1 B(p i ,a)), 

i=X 

that is, it is a combination of the multicenter functions corresponding 
to the distortion problem and the area problem. Of special interest to 
us is the multicenter function that results from the choice b = —a 2 . 
In this case, the performance function / is continuous, and we simply 
write ^dist-areaa- The extension of this function to sets of points and 
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partitions of the space reads as follows: 

Wdist-area,a(Pl, • • • , Pn, W\, . . . , W n ) 

n 

= -Y / (j4W l nB( Pl ,a),p l ) + a 2 A ll) (W i r)(S\B( Pl ,a)))y 

i=l 

We leave the proof of the following optimality result as a guided exer- 
cise for the reader (see Exercise E2.10). 

Proposition 2.15 (?^di s t-area,a- ptimality of centroid locations). 

Let {Wi,...,W n } C P(5) be a partition of S. Then, for any V = 

{ Pl ,..., Pn }eW(S), 

ftdist-area,a(<7l, • • • , <ZnJ Wl> . . . , W n ) 

> Hdist-area,a(Pl 5 ■ ■ ■ ,Pn, Wi, ..., W n ), 

where we have used the shorthands q* = CM ( p(Wi n B( P i,a)), for i G 
{l,...,n}. Furthermore, the inequality is strict if there exists i G 
{1, . . . , n} for which Wi has non-vanishing area and P i / q* . 

A consequence of this result is that for the 1-center problem, that is, 
when n = 1 — the node location that optimizes P i— > Wdist-area.a (p) = 
J(j,(S n B(p,a),p) + a 2 A ( j ) (S \ B(j>,a)) is the centroid of the set S n 
B(p, a), denoted by CM^(5 n B( P , a)). 

Next, we characterize the smoothness of the expected- value multicenter 
function. Before stating the precise result, let us introduce some useful 
notation. For a performance function /, let Dscn(/) denote the (finite) set 
of points where / is discontinuous. For each a G Dscn(/), define the limiting 
values from the left and from the right, respectively, as 

f-(a) = lim f(x), f+(a)= lim f(x). 

x— *a~ x— >a+ 

We are now ready to characterize the smoothness of 7i ex p, whose proof is 
given in Section 2.5.3. Before stating the result, recall that the line integral 
of a function g : M 2 — > R over a curve C parameterized by a continuous and 
piecewise continuously differentiable map 7 : [0, 1] — > M? is defined by 



9= g{i)di ■■= / g(i(t)) II7 
Jc Jc Jo 



\dt, 



and is independent of the selected parameterization. 



Theorem 2.16 (Smoothness properties of W exp ). Given a set S cM. d 
that is bounded and measurable, a density (ft : R — > R>o, and a performance 
function f : R>o — > R, the expected-value multicenter function 7i exp : S n — > 



?..s 
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(i) globally Lipschitz* on S n ; and 
(ii) continuously differentiable on S n \ S co \ nc , where for i G {1, . . . , n} 



^exp (p)= f d m _ p . h)mdq 



dpi Jv^v) 9pi 

+ Yl (/-(«)-/+(«))/ _ n out (^(g)dg, (2.3.6) 

_.. ,„> JVAV)ndB(v i .a) 



a£Dscn(/) 



where n out is the outward normal vector to B(pi,a). Therefore, the gradient 
ofTtexp, interpreted as a map from S n to M. n , is spatially distributed (in the 
sense defined in Section 2.2.4) over the Delaunay graph Qj). 

Let us discuss how Theorem 2.16 particularizes to the distortion, area, 
and mixed distortion-area problems. 

Distortion problem: In this case, the performance function does not have 
any discontinuities and, therefore, the second term in (2.3.6) vanishes. 
The gradient of T^ist on 5™ \ 5 C oinc then takes the form, for each 
i 6 {l,...,n}, 

9 ^(P) = 2A 4> (V i (V))(CM 4> (V i (V)) - Pi ), 

that is, the zth component of the gradient points in the direction of 
the vector going from pi to the centroid of its Voronoi cell. The critical 
points of Ttdist ar e therefore the set of centroidal Voronoi configurations 
in S (cf. Section 2.1.4). This is a natural generalization of the result 
for the 1-center case, where the optimal node location is the centroid 
CM (5). 

Area problem: In this case, the performance function is differentiable ev- 
erywhere except at a single discontinuity, and its derivative is identi- 
cally zero. Therefore, the first term in (2.3.6) vanishes. The gradient 
of W a rea,a on S n \ <S co i nc then takes the form, for each i £ {1, . . . , n}, 

C'larea.a 



dpi 



— (P) = / n out (q)<p(q)dq, 

i JVJV)ndB(v<.a) 



'Vi(V)ndB( Pi ,a) 



where n out is the outward normal vector to B(pi,a). The gradient 
is an average of the normal at each point of Vi(V) D dB(pi, a), as il- 
lustrated in Figure 2.13. The critical points of W a rea,a correspond to 
configurations with the property that each pi is a local maximum for 
the area of V i>a (P) = Vi(P)nB(pi, a) at fixed Vi{P). We refer to these 

2 Given S C K h , a function / : S — > R fe is globally Lipschitz if there exists K £ K>o such that 
ll/(z - y)h < K\\x - y\\ 2 for all x,y e S. 
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Figure 2.13 The gradient of the area function when the density function is constant. The 
component of the gradient corresponding to the rightmost node is zero; there 
is no incentive for this node to move in any particular direction. The compo- 
nent of the gradient for each of the three leftmost agents is non-zero; roughly 
speaking, by moving along the gradient directions, these agents decrease the 
overlapping among their respective disk and cover new regions of the space. 



configurations as a-limited area-centered Voronoi configurations. This 
is a natural generalization of the result for the 1-center case, where the 
optimal node location maximizes A^(S r\B(p,a)) (cf., Exercise E2.5). 

Mixed distortion-area problem: In this case, the gradient of the multi- 
center function 7Ydist-area,a,& is a combination of the gradients of TCdist 
and W a rea,a- Specifically, one has for each i £ {1, . . . , n}, 

8Hdi g p area ' a 'V ) = 2A (l> (V i , a (V))(CM (t> (V i , a (V)) - Pi ) 

- (a 2 + b) n out (q)(f>(q)dq, 

where n out is the outward normal vector to B(pi, a). For the particular 
case when b = —a 2 , the performance function is continuous, and the 
gradient of 7Ydist-area,a takes the simpler form 

d ^^^(P) = 2A 4> (V i>a (V))(CM (l) (V i>a (V))-p i ), 

which points in the direction of the vector from pi to the centroid of 
its a-limited Voronoi cell. In this case, the critical points of Wdist-area,a 
are therefore the set of a-limited centroidal Voronoi configurations in 
S (cf., Section 2.1.4). This is a natural generalization of the result 
for the 1-center case, where the optimal node location is the centroid 
CM^(Sn%a)). 

We refer to Waist; ^area,a> and Wdist-area,a as multicenter functions because, 
as the above discussion shows, their critical points correspond to various 
notions of center Voronoi configurations. 
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Note that the gradients of Tt aTe a,, a and Wdist-area,a,& are spatially distributed 
over the 2a-limited Delaunay graph t/ LD (2a). This observation is important 
for practical considerations: robotic agents with range- limited interactions 
cannot in general compute the gradient of Wdist because, as we noted in 
Remark 2.10, for a given r £ M>o, Qd is not in general spatially distributed 
over Qdisk( r )- However, robotic agents with range-limited interactions can 
compute the gradients of 7i ar ea,a and Wdist-area,a,b as long as r > 2a because, 
from Theorem 2.7(iii), G~LD( r ) is spatially distributed over Gdisk( r )- The 
relevance of this fact is further justified by the following result. 

Proposition 2.17 (Constant-factor approximation of Wdist)- Let S C 

M. d be bounded and measurable. Consider the mixed distortion- area problem 
with a £ ]0, diamS 1 ] and b = — diam(S') 2 . Then, for all P £ S n , 

Hdist-a.rea,,a,b(P) < Wdist(-P) < P ^dist-area,a,b(-P) < 0, (2.3.7) 

In fact, similar constant-factor approximations of the expected- value mul- 
ticenter function 7i exp can also be established (see Cortes et al., 2005). 



2.3.2 Worst-case and disk-covering multicenter functions 

Given a compact set Set and a performance function /, let us consider 
the point in S that is worst covered by a set of points pi, ■ ■ ■ ,p n - Formally, 
we define the worst-case multicenter function Ti WO vst ■ S n — > M by 

H „orst (pi, ••■, Pn ) = min max f (\\q - Pih) ■ (2.3.8) 

q&S ie{l,...,n} 

The definition of Ti WO rst can be read as follows: for each location q £ S, 
consider the best coverage of q among those provided by each of the nodes 
pi, . . . ,p n , which corresponds to the value maXj S / 1] „\ f(\\q — pt\\2)- Then, 
compute the worst coverage TC wors t(pi, ■ ■ ■ ,p n ) by comparing the perfor- 
mance at all locations in S. 

Given the interpretation of Ti WO rst, we seek to solve the following geometric 
optimization problem: 

maximize W wors t(pi, • • • ,Pn), (2.3.9) 

that is, we seek to determine configurations pi, . . . ,p n that maximize the 
value of TCworst- An equivalent formulation of this problem is referred to 
as a continuous p-center problem in the literature on facility location (see, 
e.g., Drezner, 1995). 
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In the present context, also relevant is the disk- covering multicenter func- 
tion T-C dc : S n -> R, defined by 

Kdcipi,--- ,Pn) = max min ||g-p;||2- (2.3.10) 

qes ie{i,...,n} 

The value of Tide can be interpreted as the largest possible distance from 
a point in S to one of the locations pi, . . . ,p n . Note that, by definition, 
the environment S is contained in the union of n closed balls centered at 
pi, . . . ,p n with radius 7Ydc(pi) • • • ,Pn)- The definition of Tide is illustrated 
in Figure 2.14(a). 

The following result establishes the relationship between the worst-case 
and the disk-covering multicenter functions, and as byproduct, provides an 
elegant reformulation of the geometric optimization problem (2.3.9). Its 
proof is left to the reader. 

Lemma 2.18 (Relationship between 7^ WO rst and Tide)- Given 5ct 
compact and a performance function f : R>o — > R, one has 7Y wor st = /°^dc- 

Using Lemma 2.18 and the fact that / is non-increasing, we can reformu- 
late the geometric optimization problem (2.3.9) as 

minimize Hdc(pi,---,Pn), (2.3.11) 

that is, find the minimum radius r such that the environment S is covered by 
n closed balls centered at pi, . . . ,p n with equal radius r. Note the connection 
between this formulation and the classical disk-covering problem: how to 
cover a region with (possibly overlapping) disks of minimum radius. We 
shall comment more on this connection later. 

Because of the equivalence between the geometric optimization prob- 
lems (2.3.9) and (2.3.11), we focus our attention on Wdc- The disk-covering 
multicenter function can be alternatively described in terms of the Voronoi 
partition of S generated by V = {pi, . . . ,p n }. For (pi, . . . ,p n ) £ S n \ S co inc, 

TCdc(pi,.--,p n ) = max max ||g-pj|| 2 
ie{i,...,n} qeVi(V) 

= max max llff — Pi\\2- (2.3.12) 

ie{l,...,n} qedViCP) 

This characterization of Tide is illustrated in Figure 2.14(b). The expres- 
sion (2.3.12) is appealing because it clearly shows the value of 7Ydc as the 
result of the aggregate contribution of all individual nodes. If (pi, . . . ,p n ) £ 
"Scoino then a similar decomposition of Tide can be written in terms of the 
distinct points V = «f(pi, • • ■ ,Pn)- A node i £ {1, . . . ,n} is called active at 
(pi, . . . ,p„) if maxggay.^) \\q - Pi\\ 2 = Hd c (pi, • • • ,Pn)- A node is passive at 
(pi, . . . ,p n ) if it is not active. 
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(a) 



(b) 



Figure 2.14 An illustration ol the definition of Tide'- (a) and (b) show the same config- 
uration, with and without the Voronoi configuration, respectively. For each 
node, the disk is the minimum-radius disk centered at the node and enclosing 
the Voronoi cell. The value of Tide is the radius of the disk centered at the 
leftmost node. 

Inspired by expression (2.3.12), let us define a more general version of the 
disk-covering multicenter function. Given (p\, . . . ,p n ) G S n and a partition 
{W u ...,W n } cP(S) of 5, let 



Hdc(Pl,---,Pn,Wi, 



Wr, 



max max \\q 
i£{l,...,n} qedWi 



Pi\\2- 



Note the relationship H dc {pi, ...,p n ) = W dc (pi, ■ • • ,Pn, Vi(V), . . . , V n (V)), 
for all (pi, . . . ,p n ) eS n \ 5 co inc- Moreover, one can establish the following 
optimality result, whose proof is given in Section 2.5.4. 

Proposition 2.19 (7^dc - °ptimality of the Voronoi partition and cir- 
cumcenter locations). For any V = {p±, . . . ,p n } G ¥(S) and any parti- 
tion{W l ,...,W n }anS) ofS, 

n dc ( Pl , ...,p n , Vl(V), ■-., V n {V)) < H dc (px, ...,p n ,Wx,..., W n ), 

that is, the Voronoi partition V(V) is optimal for Ti dc among all partitions 
of S, and 

Hdc(cc(wu • • • , cc{w n ), Wi,..., w n ) < n dc ( P i, ..., Pn ,w 1 ,...,w n ), 

that is, the circumcenter locations CC(Wi), . . . , CC(W n ) are optimal for 7i dc 
among all configurations in S. 

As a corollary of this result, we have that the circumcenter of S is a global 
optimum of "H dc for the 1-center problem, that is, when n = 1. This comes 
as no surprise since, in this case, the value 7i dc (p) corresponds to the radius 
of the minimum-radius sphere centered at p that encloses S. 
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The following result characterizes the smoothness properties of the disk- 
covering multicenter function; for more details and for the proof, see Cortes 
and Bullo (2005). 

Theorem 2.20 (Smoothness properties of Tide)- Given 5cR com- 
pact, the disk-covering multicenter function Tide '■ S n — > M. is globally Lips- 
chitz on S n . 

The generalized gradient and the critical points of Tide can be charac- 
terized, but require a careful study based on nonsmooth analysis (Clarke, 
1983). In particular, two facts taken from Cortes and Bullo (2005) are of in- 
terest here. First, under certain technical conditions, one can show that the 
critical points of Tide are circumcenter Voronoi configurations. This is why 
we refer to "Hdc as a multicenter function. Second, the generalized gradient 
of 7Ydc is not spatially distributed over Qd. This is essentially due to the 
inherent comparison among all agents that is embedded in the definition of 
Tide (via the max function). 



2.3.3 Sphere-packing multicenter functions 

Given a compact connected set S C M rf , imagine trying to fit inside S "max- 
imally large" non-intersecting balls. Assuming that the balls are centered 
at a set of points pi, ■ ■ ■ ,p n , we aim to maximize their smallest radius. We 
define the sphere-packing multicenter function TC sp : S n — > R by 

H sp (pi,...,Pn) = min \-\\pi - pj\\ 2 ,dist(pi,dS)\. (2.3.13) 

ij^j£{l,...,n} I. Z J 

The definition of TC sp can be read as follows: consider the pairwise distances 
between any two points pi, pj (multiplied by a factor 1/2 so that each point 
can fit a ball of equal radius and these balls do not intersect), and the indi- 
vidual distances from each point to the boundary of the environment. The 
value of Ti sp is then the smallest of all distances, guaranteeing that the union 
of n open balls centered at pi, . . . ,p n with radius TC S p(pi, ■ ■ ■ ,Pn) is disjoint 
and contained in S. The definition of H. sp is illustrated in Figure 2.15(a). 

Given the definition of TC S p , we seek to solve the following geometric op- 
timization problem: 

maximize Tt sp (pi, ... ,p n ), (2.3.14) 

that is, we seek to determine configurations pi, ■ ■ ■ ,p n that maximize the 
value of TC S p- Note the connection of this formulation with the classical 
sphere-packing problem: how to maximize the number of fixed-radius non- 
overlapping spheres inside a region. 
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(a) (b) 

Figure 2.15 An illustration of the definition of 7i sp : (a) and (b) show the same config- 
uration, with and without the Voronoi configuration, respectively. For each 
node, the disk is the maximum-radius disk centered at the node and contained 
in the Voronoi cell. The value of Ti ap is the radius of the two equal-radius 
smallest disks. 



The sphere-packing multicenter function can be alternatively described 
in terms of the Voronoi partition of S generated by V = {pi, . . . ,p n }- For 
(pi, . . . ,p n ) £ S n \ cS C oinc, one has 

H 8 p(pi,...,p n )= min min ||g-p l || 2 . (2.3.15) 

ie{l,...,n} qedVi(P) 

This description is illustrated in Figure 2.15(b). As for the previous multi- 
center functions, expression (2.3.15) is appealing because it clearly shows the 
value of of 7i sp as the result of the aggregate contribution of all individual 
nodes. If (pi, . . . ,p n ) £ 5 co i nc , then a similar decomposition of H sp exists 
in terms of the distinct points V = ir(pi, ■ ■ ■ ,p n )- A node i £ {1, . . . , n} 
is called active at (pi, ... ,p n ) if min ?ea y.(-p) \\q - pi\\ 2 = H sp (j>i, . . . ,p n ). A 
node is passive at (pi, . . . ,p n ) if it is not active. 

Inspired by expression (2.3.15), let us define a more general version of 
the sphere-packing multicenter function. Given (pi,...,p n ) £ S n and a 
partition {Wi, . . . , W n } C P(S) of S, let 

H sp (pi, ...,p n ,Wi,..., W n ) = min min \\q - pi\\ 2 . 

ie{l,...,n} q&dWi 

Note the relationship W sp (pi, • • • ,Pn) = H sp (pi, ...,p n , Vi(V), ..., V n (V)), 
for all (pi,...,p n ) £ S n \ 5 C oinc- Additionally, note that the quantity 
H sp (qi,. ..,q n ,Wi,.. . ,W n ) is the same for any q t £ IC(Wj), i £ {l,...,n}. 
With a slight abuse of notation, we refer to this common value using the 
symbol H sp (lC(Wi), . . . , lC(W n ), W\, . . . , W n ). Moreover, one can establish 
the following optimality result (for the proof, see Section 2.5.5). 
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Proposition 2.21 (W sp -optimality of the Voronoi partition and in- 
center locations). For any V = {pi,- ■ ■ ,p n } G ¥(S) and any partition 
{W u ...,W n }cF(S) ofS, 

H sp (pi, ..., Pn , Vi(V), ..., V n (V)) > H sp (pi, ..., Pn ,Wl,...,W n ), 

that is, the Voronoi partition ViV) is optimal for 7i sp among all partitions 
of S, and 

n ap {ic{Wi), . . . , ic(w„), w 1 ,...,w n )> ^(pi, ...,pn,w u ...,w n ), 

that is, the incenters IC(Wi), • • • )IC(W n ) are optimal for 7i sp among all 
configurations in S. 

As a corollary of this result, we have that the incenter set of S is composed 
of global optima of 7i sp for the 1-center problem, that is, when n = 1. 
This comes as no surprise since, in this case, the value 'H sp (p) corresponds 
to the radius of the maximum-radius sphere centered at p enclosed in S. 
The following result characterizes the smoothness properties of the sphere- 
packing multicenter function (see Cortes and Bullo, 2005). 

Theorem 2.22 (Smoothness properties of 7i sp )- Given Set com- 
pact, the sphere-packing multicenter function Tt sp : S n — > R is globally Lip- 
schitz on S n . 

We conclude this section with some remarks that are analogous to those 
for the function Ti^. The generalized gradient and the critical points of 
7i sp can be characterized, but require a careful study based on nonsmooth 
analysis (Clarke, 1983). In particular, two facts taken from Cortes and Bullo 
(2005) are of interest here. First, under certain technical conditions, one can 
show that the critical points of 7i sp are incenter Voronoi configurations. This 
is why we refer to 7i sp as a multicenter function. Second, the generalized 
gradient of Ti. sp is not spatially distributed over Qd . This is essentially due to 
the inherent comparison among all agents that is embedded in the definition 
of 7i sp (via the min function) . 

2.4 NOTES 

A thorough introduction to computational geometric concepts can be found 
in Preparata and Shamos (1993), de Berg et al. (2000), and O'Rourke (2000). 
The handbooks Goodman and O'Rourke (2004) and Sack and Urrutia (2000) 
present a comprehensive overview of computational geometric problems and 
their applications. Among the numerous topics that we do not discuss in 
this chapter, we mention distance geometry and rigidity theory (Whiteley, 
1997), which are notable for their applications to network localization and 
formation control. 
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The notion of Voronoi partition, and generalizations of it, have been ap- 
plied in numerous areas, including spatial interpolation, pattern analysis, 
spatial processes modeling, and optimization, to name a few. The sur- 
vey Aurenhammer (1991) and the book by Okabe et al. (2000) discuss the 
history, properties, and applications of Voronoi partitions. The nearest- 
neighbor and natural-neighbor interpolations based on Voronoi partitions 
(see, for example Sibson, 1981; Boissonnat and Cazals, 2002) are of par- 
ticular interest to the treatment of this chapter because of their spatially 
distributed computation character. Spatially distributed maps for motion 
coordination are discussed in Martinez et al. (2007c) and adopted in later 
chapters. 

Proximity graphs (Jaromczyk and Toussaint, 1992) are a powerful tool 
to capture the structure and shape of geometric objects, and therefore have 
applications in multiple areas, including topology control of wireless net- 
works (Santi, 2005), computer graphics (Langetepe and Zachmann, 2006), 
and geographic analysis (Radke, 1988). The connectivity properties of cer- 
tain proximity graphs (including those stated in Theorem 2.8) are taken 
from Cortes et al. (2005, 2006). In cooperative control, a closely related 
notion is that of state-dependent graph (Mesbahi, 2005). Random geomet- 
ric graphs (Penrose, 2003) and percolation theory (Bollobas and Riordan, 
2006; Meester and Roy, 2008) study the properties of proximity graphs as- 
sociated to the random deployment of points according to some specified 
density function. 

Locational optimization problems (Drezner, 1995; Drezner and Hamacher, 
2001) are spatial resource-allocation problems (e.g., where to place mail- 
boxes in a city, or where to place cache serves on the internet) that pervade 
a broad spectrum of scientific disciplines. Computational geometry plays 
an important role in locational optimization (Robert and Toussaint, 1990; 
Okabe et al., 2000). The field of geometric optimization (Mitchell, 1997; 
Agarwal and Sharir, 1998; Boltyanski et al., 1999) blends the geometric and 
locational optimization aspects to study a wide variety of optimization prob- 
lems induced by geometric objects. The smoothness properties of the cost 
function Ti e ^ P are taken from Cortes et al. (2005). 

2.5 PROOFS 

This section gathers the proofs of the main results presented in the chapter. 
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2.5.1 Proofs of Theorem 2.7 and Theorem 2.8 

Proof of Theorem 2. 7. The inclusions in fact (i) are taken from Jaromczyk 
and Toussaint (1992), and de Berg et al. (2000). The proof of the first 
inclusion in fact (ii) is as follows. Let (pi,Pj) G ^Q G r[g Ai ^(r)^P)- From the 
definition of the Gabriel graph, we deduce that \\ Pi Pi — pi\\2 = || P ' 2 P3 — 
Pj 1 1 2 < || Pi 2 Pj ~~ Pk\\2, for all k € {1, . . . ,n} \ {i,j}, and therefore, Pi 2 Pj G 
Vi(V)nVj(V). Since {vi,Pj) G £g disyL (r)(P), we deduce that 2i±& g B( Pi , §)n 
B(pj,^), and hence (pi,Pj) G ^GldO)^)' ^e second inclusion in (ii) is 
straightforward: if (p t ,Pj) G £g LD (r)CP), then ^(P) D V,(P) / 0, that is, 
{Pi,Pj) G £g (P)- Since clearly (pj,Pj) G £g diak (r)0P), we conclude (ii). ■ 



Proof of Theorem 2.8. The proof of fact (i) is as follows. Let V G F( 
If ^emst(^) GJ <?disk(0(^)> tri en clearly ^ disk (r)(P) is connected. To prove 
the other implication, we reason by contradiction. Assume (?disk( r )(^ > ) i s 
connected and let ^emstC^ 5 ) <2 (?disk( r )('P)) that is, there exist pi and pj 
with {pi,Pj) G ^emst^) an d IlPi ~~ P j 1 1 2 > r. If we remove this edge 
from £g EMST (V), then the tree becomes disconnected into two connected 
components T\ and T2, with pi G Ti and p.,- G T2. Now, since by hypoth- 
esis ^disk('*)(7 3 ) is connected, there must exist k, I G {l,...,n} such that 
Pk G Ti, p; G T 2 and ||p fc - pi\\ 2 < r. If we add the edge (pk,Pi) to the 
set of edges of T\ U T 2 , then the resulting graph G is acyclic, connected, 
and contains all the vertices V, that is, G is a spanning tree. Moreover, 
since \\pk — P1W2 < f < ||Pi — Pjlh and Ti and T 2 are induced subgraphs of 
Q'EMSii'P)-, we conclude that G has smaller length than Gemst(P), which 
is a contradiction with the definition of the Euclidean minimum spanning 
tree. 

Next, we prove fact (ii). For r G R+, it suffices for us to show that 
Gemst n<5 disk (r) has the same connected components as £ disk (r), since this 
implies that the same result holds for £/rn n£?disk(0> Gg H £/disk(0> an d 
£?ld(»")- Since £emst ^G<iisk( r ) is a subgraph of Gdisk( r ), it is clear that ver- 
tices belonging to the same connected component of <?emst ^Gdisk(f) must 
also belong to the same connected component of Gdisk( r )- To prove the con- 
verse, let V G F(R d ), and assume that pi and pj in V verify \\pi — Pj\\ 2 < r. 
Let C be the connected component of Gdisk{. r )(J > ) to which they belong. 
With a slight abuse of notation, we also denote by C the vertices of the con- 
nected component. Since C is connected, then Gemst(C) C C by fact (i). 
Moreover, since all the nodes in V \ C are at a distance strictly larger than 
r from any node of C, we deduce from the definition of the Euclidean min- 
imum spanning tree that Gemst(C) is equal to the subgraph of ^emst('P) 
induced by C. Therefore, Qemst(C) C Gemst D Gdisk(r)(V), and p t and 
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Pj belong to the same component of C/emst nt/ disk (r)(7 : '). This implies the 
result. ■ 



2.5.2 Proof of Proposition 2.9 

Proof. Regarding the statement on t/ RN n<5disk( r )> note that 

B(pi, \\pi -Pjh)^B(p j ,\\p i -Pjh) C B(pi, \\pi -Pjh)- 

Therefore, if \\pi — Pj\\2 < T, then any node contained in the intersection 
B(pi, \\Pi ~ Pj II 2) f^B(pj, \\pi — p j 1 1 2 ) must necessarily be within a distance 
r of pi. From here, we deduce that £?rn (~l £disk(0 is spatially distributed 
over <5disk(0- Regarding the statement on Qq n<5disk(?")> n °t e that 

ryfPi+Pj \\Pi ~Pjh\ ^ ry, n n ^ 

By — y^, 2^) B ^W^-"Pjh)- 

Therefore, if \\pi — Pj\\2 < T, then any node contained in B( Pi 2 Pj , "P i ~P'" a j 
must necessarily be within a distance r of pj. From here, we deduce that 
Gg H ^disk(f) is spatially distributed over £?disk(0- Finally, note that if \\pi — 
P3W2 > r, then the half-plane {q G R 2 | ||g — p^jb < \\q — P3W2} contains the 
ball B(pi,^). Accordingly, 

v h ,(v) = v l (v)nB( Pu r i) 



fee* Ik-Pilb < Ik ~ Pjh, for allpj G V} r\B(pi, 



2 



= {? 6 R I \\q-Pih < h-Pjh, for all Pj eJV Mf)i?j (?)}nB(K,0, 

from which we deduce that £/ld(/) is spatially distributed over <?disk( r )- ^ 

2.5.3 Proof of Theorem 2.16 

We begin with some preliminary notions. In the following, a set Q c R 2 
is piecewise continuously differentiable if its boundary, dfl, is a not self- 
intersecting closed curve that admits a continuous and piecewise continu- 
ously differentiable parameterization 7 : [0, 1] — > R 2 . Likewise, a collection 
of sets {Q(x) C R 2 I x G (a, 6)} is a piecewise continuously differentiable 
family if Q(x) is piecewise continuously differentiable for all x G (a,b), and 
there exists a continuous function 7 : [0,1] x (a, 6) — > R 2 , (t,x) 1— > 7(t,x), 
continuously differentiable with respect to its second argument, such that 
for each x G (a, 6), the map 1 1— > 7 z (t) = 7(£, x) is a continuous and piecewise 
continuously differentiable parameterization of dQ(x). We refer to 7 as a 
parameterization for the family {f2(x) C R 2 | x G (a, b)}. 
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The following result is an extension of the Law of Conservation of Mass 
in fluid mechanics (Chorin and Marsden, 1994) and of the classic divergence 
theorem in differential geometry (Chavel, 1984). 

Proposition 2.23 (Generalized conservation of mass). Let {Q(x) C 
R 2 | x G (a, &)} be a family of star-shaped sets with piecewise continuously 
differentiable boundary. Let the function eft : R 2 x (a, b) — > R be continuous 
on R 2 x (a, b) that is continuously differentiable with respect to its second 
argument for all x G (a, b) and almost all q G Q,(x), and such that for each 
x G (a, b), the maps q i— > (p(q,x) and q i— > g§(<7, x) a?"e measurable, and 
integrable on fi(x). Then, the function 



a, 6)3xi— > / cf)(q,x)dq (2.5.1) 



is continuously differentiable and 



where n : 9f2(x) — > R 2 , g h- > n(g) ; denotes the unit outward normal to dfl(x) 
at q G <9Q(x), and 7 : [0, 1] x (a, b) — > R 2 is a parameterization for the family 
{n(x) CR 2 I cc G (a, &)}. 

We interpret the proposition as follows: in the fluid mechanics interpreta- 
tion, as the parameter x changes, the total mass variation inside the region 
can be decomposed into two terms. The first term is the amount of mass 
created inside the region, whereas the second term is the amount of mass 
that crosses the moving boundary of the region. 

Proof of Proposition 2.23. Let xo G (a,b). Using the fact that the map 
7 is continuous and that CI(xq) is star-shaped, one can show that there 
exist an interval around Xo of the form (xq — c,xq + e), a continuously 
differentiable function u Xo : [0, 1] x R> — > R 2 and a function r Xo : [0, 1] x 
(xq — s, xq + e) — > R>o continuously differentiable in its second argument 
and piecewise continuously differentiable in its first argument, such that for 
all x G (xq — e, xo + e), one has 

n(x) = U te [0,1] {u Xo (t,s) I < s < r Xo (t,x)}, 
7(t,x) = u Xo (t,r Xa (t,x)), for all t G [0,1]. 

For simplicity, we denote by r and u the functions r Xo and u Xo , respectively. 
By definition, the function in (2.5.1) is continuously differentiable at xo if 
the following limit exists: 

lim-( / 4>(q,x + h)dq- / <j)(q,x )dq), 
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and depends continuously on xq. Now, we can rewrite the previous limit as 



lim — 
7i->0 h j 



r(t,x +h) 



cj)(u(t,s),xo + h) 

r(t,x ) 

cp(u(t,s),x ) 







du du 

dt ds 

du du 

dt ds 



ds 



ds)dt 



lim — 
fc->o h 



1 . rr(t,x +h) 

( / (f>(u(t,s),x + h) 

'0 X Jr{t,x ) 

+ / ((j)(u(t, s),x + h) - <f>(u(t,s),x ))\ 

Jo 



du du\ 
dt ds I 

du du 
— x — 
dt ds 



ds 



dsjdt, (2.5.2) 



where x denotes the vector product and for brevity we omit the fact that 
the partial derivatives ^ and 4ij are evaluated at (i, s) in the integrals. 
Regarding the second integral in the last equality of (2.5.2), since 

1 / 1 1 du 

lim -l((f>(u(t,s),XQ + h) - <f>{u(t,s),x ))\\— x 
h->o n\ I dt 



du du 

ds 



dxt 



(u(t,s),x ) 



du du 
dt ds 



almost everywhere, and this function is measurable and its integral over 
the bounded set O(xo) is finite by hypothesis, the Lebesgue Dominated 
Convergence Theorem (Bartle, 1995) implies that 

I pi rr(t,x ) 

((j)(u(t, s), x + h)- 4>(u(t, s), Xq)) 



lim 

hr^OhjQJO 



du du 
dt ds 



dsdt 



1 r r(t,x ) q^ ,,g u q u 

(u(t,s),xo)\\— X 

^0 



n(x ) 



dx 



dx 
(q,x )dq. 



dt ds 



dsdt 



(2.5.3) 



On the other hand, regarding the first integral in the last equality of (2.5.2), 
using the continuity of <f>, one can deduce that 

i rl rr(t,x +h) 



lim 

h^Oh 



0Jr(t,x o ) 

i r 1 r x o+h 

lim — 

h^O h 



Oil Oil 

u(t,s),x + h) —(t,s)x—(t,s) 
dt ds 



dsdt 



{u(t,r(t,z)),x + h) 



0Jx o 



f 

Jo 



Oil Oil OT 

— (t, r(t, z)) x — (t, r(t, z)) 2 Q^(t, z ) dz dt 



Oil Oil 

u(t, r(t, Xq)), Xq) — (i, r(t, Xq)) X —(t, r(t, Xq)) 



dt 



ds 



dr 

2dxQ 



(t, Xq) dt. 
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Since 7(4, x) = u(t, r(t, x)) for all t £ [0, 1] and x £ {xq — e,xo + e), one has 
dj ; 

at 
57 



-(t,x ) 
-(t,x ) 



— (£,r(£,x )) + —(t,r(t,xo)) — (t,x ). 
dt as dt 



du dr 

fix- ^(^(t,xo))^(t,x ). 



Let x denote the angle formed by -^{t,xo) and §j(t, r(t, Xq)). Then (omit- 
ting the expression (t,r(t,x)) for brevity), 



<9u du 
dt ds 



du du dr \ du 
dt ds dt J ds 



2 ds 



2 

^711 11 dun . || d") 

dt II2II as II2 II dt 

where in the last inequality we have used the fact that, since j Xo is a param- 
eterization of afi(xo), then sin% = cos ip, where ip is the angle formed by n, 
the outward normal to dQ(xo), and ^. Therefore, we finally arrive at 



<i>h(t),xo] 



du du 

— (t,r(t,x ))x—(t,r(t,x )) 



Or 
2dx 



(t, xo)dt 



<p(j(t),x ) —(t,xo)\ n T (7(t,x ))^-(t,x )(it 







dt 



dx 



dj 



dQ(x a ) 



4>(l,xo)n (7)^:^7- 



(2.5.4) 



Given the hypothesis of Proposition 2.23, both terms in (2.5.3) and (2.5.4) 
have a continuous dependence on xo £ {a,b). This concludes the proof. ■ 

We are finally ready to state the proof of the main result of Section 2.3. 



Proof of Theorem 2. 1 6. We prove the theorem statement when the perfor- 
mance function is continuously differentiable and we refer to Cortes et al. 
(2005) for the complete proof for the case when the performance function 
is piecewise continuously differentiable. Specifically, we show that if / is 
continuously differentiable, then for P £ S n \ 5 C oinc; 



dU 



exp 



dpi 



(P) 



ViCP) 



_d_ 

dp, 



f(\\q-Pih)4>{q)dq. 
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From Proposition 2.23, we have 

if"(E / f(k-Pjh)Hl)dq) = I J^f(\\q-Pih)H<l)dq 

d P* K T^Jv,(P) ' Jv,(v)dpt 

+ J2 v(Phl) ( n (7j) • ^f) d lh 

~,JdVAV) V °Pi J 



i=i 



i=i 



where 7^ is a parametrization of Vj(V) and where we abbreviate tp(pj,q) = 
f(\\q — Pj\\2)4 > (q)- Next, we show that the second term vanishes. Note that 
the motion of pi affects the Voronoi cell Vi(V) and the cells of all its neighbors 
in J\fg n , Pi (V). Therefore, the second term equals 

Without loss of generality, assume that Vi(V) does not share any face with 
dS. Since the boundary of Vi(V) satisfies dVi(V) = IL Ay, where Ajj = Aji 
is the edge between Vi(V) and Vj(V), for all neighbors pj, we compute 

<p(pi, q) (n(7») • Tr) d ^ = H / V'CWj 9) f"*i(7i) • 7^ ) d 7j, 



/ ( P(Pj,q)(n(nf j )~)dy j = V>(Pj,q)(n J i(l j )-^-)d lj , 

JdVjiV) V "Pi' JA j; V "Pi 7 

where n^ denotes the unit normal along Ay outward of V%(P). Noting that 
riji = —riij and collecting the results obtained so far, we write 



J2 / v(Pi.2)K7i)'7^W 

H / (v(P*> 9) - ^(Pj, ^)) (n»i(7i) ' tt^) c?7j- 

This quantity vanishes because /(||g — Pilh) = /(Ik ~~ Pjlk), an d therefore 
y(P») q) = ^(Pji q) f° r an y 1 belonging to the edge Ay. ■ 



2.5.4 Proof of Proposition 2.19 

Proof. Recall that H Ac (j>i, ...,p n ) = Hdc(Pi> ■••iPn, Vi(V), • ■ • , K(^))- To 
show the first inequality, let j G {!,..., n} and q* G Vj(V) be such that 
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T~(-dc(pi, ■ ■ ■ ,Pn) = Ik* — Pj\\2- By definition, given a partition {W±, . . . , W n } 
of S, there exists k such that q* £ Wfc. Therefore, 

W dc (pi,---,Pn) = Ik* -Pilb < Ik* -pkh 

< max |k-pj|| 2 < H& c {pi,...,p n ,Wi,..., W n ). 

q&W k 

To show the second inequality, note that the definition of circumcenter im- 
plies that, for each i £ {1, . . . , n}, 

max |k - CC(Wi)|| 2 < max \\q - p t \\2- 

q&dWi q£dWi 

Taking the maximum over all nodes, we deduce that 

Hdc(cc(wu . . . , cc(w n ), wi, . . . , w n ) < n dc (p u ..., Pn ,w 1 ,...,w n ), 

as claimed. ■ 



2.5.5 Proof of Proposition 2.21 

Proof. Recall that W sp (pi, ■ • • ,Pn) = Hs P G?i, . . . ,Pn, ^i(P), . . . , V^P)). To 
show the first inequality, let j £ {1, ...,n} and g* in^V^T 3 )) be such 
that Hspipi, ■■ ■ ,p n ) = Ik* — Pj 1 1 2 ■ Since q* int(Vj(7 3 )), there exists i £ 
{1, . . . , n} such that |k* — Pjh > Ik* — Pi\%- On the other hand, there must 
exist k £ {1, . . . , n} such that q* £ Wk- Now, if A: = j, then q* int(Wj). 
Therefore, 

w sp (pi, . . . ,p n ) = Ik* -Pjh > Ik* — Pilb 

> min |k-pj|| 2 > Ti sp (pi,...,p n ,Wi,...,W n ). 

q0nt{Wi) 

Now, if k = i, then q* g" int(F4 / j). Therefore, 
T-Csp(P) = \\q* ~ Pjh > min ||g -Pi||2 > W sp (pi, . . . ,p n , Wi, . . . , W n ). 

q0nt{Wj) 

Finally, if k ^ i,j, then g* int(Wj) U int(Wj), and a similar argument 
guarantees H sp (pi, ...,p n )> H sp (pi, . . . ,p n , Wi, ■ • • , Wn)- 

To show the second inequality, let i £ {1, . . . , n} and select % £ IC(Wi). 
The definition of the incenter set implies that, 

min |k - Qih > min \\q - pi\\ 2 . 

q€dWi q&dWi 

The expression on the left does not depend on the specific point selected in 
the incenter set. Taking the minimum over all nodes, we deduce that 

W sp (IC(Wi), . . . , IC(W n ), W!,...,W n )> H Bp (pi, ...,p n ,W u ...,W n ), 

as claimed. ■ 
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2.6 EXERCISES 

E2.1 (Proof of Lemma 2.2). For S = {pi, . . . ,p„} G F(R d ) with n > 2, prove the 
following statements: 

(i) CC(5) eco(S')\Ve(co(5)); 

(ii) if p S co(5) \ {CC(5)} and r £ R>o are such that S C B(p,r), then the 
segment ]p,CC(S)[ has a nonempty intersection with _B(^2, §) for all 
q e co(S). 
Hint: To show (i), invoke the definition of circumcenter. To show (ii), distinguish 
between the case when \\p— q\\2 < r and \\p— q\\2 — r. A proof is contained in Cortes 
et al. (2006). 

E2.2 (The centroid of a convex set is an interior point). Let S be a bounded 
measurable convex set in K d and let cj> : S — > R>o be a bounded measurable 
density function that is positive over S. Show that 

CM^(S) <= int(S). 



E2.3 (The inclusion <5ld(0 C Gu n Gdis^ir) is in general strict). Consider the 
nodes p\ — (0,0), P2 = (1,0), and pz = (2, i). Pick r = 3 and perform the 
following tasks: 

(i) draw the three points, their Voronoi polygons and the disks centered at 
the points with radius r; and 

(ii) show that pi and p% are neighbors in the graph Qu fl SdiskW, but not in 
the graph C/ldM- 

E2.4 (The proximity graph Gd fl 5disk('") is not spatially distributed over 

Gdi B k(r)). Consider the nodes pi = (0,0), p 2 - (1,0), p 3 = (2,^), and p 4 = 
(0, f^j). Compute the Voronoi partitions of the plane generated by {pi,P2-P3} 
and {pi,p2,P3,P4}- For r = 3, show that pi and P3 are neighbors in the graph 
GDr\Gdisk(r)({pi,P2,Ps}) but not in the graph Gd nGdi B k(r)({pi,P2,P3,Pi})- Why 
does this exercise illustrate that Gv> fl C/disk('") is not spatially distributed over 

5d iS k(r)? 

E2.5 (1-center area problem). Let W C R 2 be a convex polygon, let be a density 
function on M 2 , and let a £ R>o- Assume that the a-contraction of W is non- 
empty. Consider the area function Hi : W — » R, defined by 



Hi(p) = / 4>{q)dq = A#n B(p, a)). 

JWnB(p,a) 

Justify informally why, at points in the boundary of a convex polygon W , the gra- 
dient of Tli is non- vanishing, and points toward the interior of the polygon. (Note 
that it is not known whether the function Hi is concave and how to characterize 
critical points of Hi in geometric terms.) 

E2.6 (Concavity of performance function and 1-center function). Given a 

performance function /, define the 1-center function 7i exPi i : S — > R by 



Wex P ,i(p) = / f{\\i-ph)4>{q)dq- 
J s 

Prove the following facts: 
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(i) if / is concave, then 7Y e x P ,i is concave; and 

(ii) if / is concave and decreasing and S has positive measure, then 7i eX p,i 
is strictly concave. 

E2.7 (Fermat— Weber center). Let S C M 2 be a convex polygon and let ^ be a 
density function on S. Define the Fermat-Weber function TLf\n '■ R ^ M by 



Hfw(p) = / \\p — qh<t>(q)dq. 
Js 



(i) Prove that 7Yfw is strictly convex. 

(ii) Show that 7Yfw has a unique global minimum point inside S. 

(hi) Compute the derivative of 7ipw an d propose an algorithm to compute 
the global minimum point. 

(iv) Is the function strictly convex even if the polygon S is not convex? 
The unique minimum of 7Yfw is called the Fermat-Weber point or, alternatively, 
the median point of the region S. Further details on this problem are available 
in Fekete et al. (2005) and references therein. 

E2.8 (Proof of Proposition 2.14). In this exercise, you are asked to prove a state- 
ment that is slightly more general than Proposition 2.14. Let {Wi, . . . , W n } C 
P(S*) be a partition of S C K d and let ^ be a density function on R d . Select 
{pi, . . . ,p n }, {Pi, ■ • • ,P n } £ F(£) with the property that, for all i £ {1, . . . , n}, 

\\p t - CM*(W«)|| a < lift - (M^(Wi)h. 
Show that 

Wdtatfo, • • • ,Pn> Wi, . . . , W n ) > WdtatCPl, • ■ ■ ,Pn, W U . . . , W n ), 

and that the inequality is strict if there exists i £ {l,...,n} such that \\p l — 
CM <# ,(W A i )|| 2 < \\pi — CM0(Wi)|| 2 and such that Wi has positive area. 
Hint: Use the expression of TLdmt in (2.3.5). 

E2.9 (Mixed distortion-area multicenter function). Show that the expected mul- 
ticenter function 7i exp takes the form of 7Ydist-area,a,6 stated in Section 2.3.1 when 
the performance function is 

f(x) = -x 2 l[ ,a](aO + b ■ l ]a , +oo[ (2:), 

with a £ R>o and b < —a . 

Hint: As an intermediate step, show that for P = (pi, . . . ,p n ) £ S n , one has 

Vi(P) n (S \ B(pi,a)) = Vi(P) n (S \ UJUBfo, o)) for all i £ {1, . . . , n}. 

E2.10 (Proof of Proposition 2.15). This exercise is aguided proof of Proposition 2.15. 
Let W C M. d be a connected set, let <^> be a density function on R d , and let o £ M>o- 
For p £ W and B a closed ball centered at a point in W with radius a, define 
(p,B)^Hw(p,B) by 

Hw{p,B) = - / _||q-p||20('?)rf?- / _ a 2 4>(q)dq. 

JwnB Jwn(s\B) 

Do the following: 
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(i) Show that the multicenter function Wdist-area,a admits the expression 

WdUt-area,o(pi,- ■ ■ , Pn, Wl, ■ ■ ■ , Wn) = ^HWjiPi, B(pj, a)). 

i = l 

(ii) Given a closed ball B centered at a point in W with radius a, show that 
for any p £ W, 

Hw (CM r p(W nS),B)> Hw (p, B) , 

with strict inequality unless p = CM^(W 1*1 B). 

Hint: Use the Parallel Axis Theorem (Hibbeler, 2006). 

(iii) Given p £ W, show that for any closed ball B centered at a point in W 
with radius a, 

Hw(p,B{p,a)) >H W (P,B). 

Hint: Consider the decomposition of W given by the union of the disjoint 
setsB(p,a)nB, B(p,a)n{W\B), {W\B(p,a))nB and (W\B(p,a))n 
(W \ B), and compare the integrals over each set. 

(iv) Deduce, using (ii) and (iii), that 

Hw(CM^{W n B{p, a)),B(CM^(W n B(p, a)), a)) > H w (p, B(p, a)), 

with strict inequality unless p = CM<f,(W D B). 

(v) Combine (i) and (iv) to prove Proposition 2.15. 

E2.ll (Locally cliqueless proximity graph). Give an example of an allowable envi- 
ronment Q and a configuration of points such that the following inclusions (taken 
from Theorem 2.11(i)) are strict for Q = G v \ s ,q: 

<?emst,5 C Q\ c ,g C Q, 



E2.12 (Properties of the locally cliqueless graph). Prove Theorem 2.11. 

Hint: This exercise has notable theoretical content. To prove Theorem 2.11(i), 
use an argument by contradiction to show that the first inclusion holds, and use 
the definition of locally cliqueless graph to show that the second inclusion holds. 

E2.13 (When are the total derivative and the partial derivative of a function 
equal?). Assume that / : 1x1 — > M is continuously differentiable in its both of its 
arguments and let dif be its partial derivative with respect to its first argument. 
Assume that the function y* : R — » R satisfies, for each x € R, 

f(x,y*(x)) = max{/(i,z) | z e R}, 
and is continuously differentiable. Perform the following tasks: 
(i) Show that 

^f(x,y*(x)) = d 1 f(x,y*(x)). (E2.1) 

(ii) Explain how this result gives an insight into the expression of the gradient 
of 7iexp in Theorem 2.16(h) for a continuously differentiable performance 
function. Also, explain why this formula is not directly applicable to the 
function "Wexp- 
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Note that equation (E2.1) is referred to as the envelope theorem in the economics 
literature. 

E2.14 (Distortion gradient ascent flow). Given a (convex) polytope Scl d and a 
density function <fi, consider n nodes pi, . . . ,p n evolving under the continuous-time 
gradient ascent flow of the multicenter function Hdist , 

Pl = 2A 4 ,(V i (V))(CMt(V i (V)) - Pi ), i 6 {1, . . . ,n}. 

(i) What are the equilibrium points? 

(ii) Show that Tldist is monotonically non-decreasing along the flow. 

(iii) Show that the set S N is invariant, i.e., that the trajectories of all nodes 
remain in S. 

(iv) Use (i)-(iii) to apply the LaSalle fnvariance Principle and show that the 
solutions of the flow converge to the set of centroidal Voronoi configura- 
tions in S. 

(v) Implement numerically the flow in the software of your choice. Select the 
unit square S — [0, 1] x [0, f ] and the density function 

<^ = exp(- (x- -) 2 - (y- -) 2 ) +exp(-(z- -) 2 - (y - -) 2 ). 

Run simulations from different initial conditions and with different num- 
bers of nodes. Show by illustration that multiple local maxima exist. 
Hint: To perform step (iv), one should also prove that any two nodes never con- 
verge to the same location (in finite or infinite time); this property needs to be 
established because the function Tldist is not differ entiable on such configurations. 
For this and the next exercise, do not worry about proving this property and instead 
refer to Cortes et al. (2005, Proposition 3.1). 

E2.15 (Area gradient ascent flow). Given a (convex) polytope S C R d , a density 
function (j>, and a radius a £ K>o, consider n nodes pi, . . . ,p n evolving under the 
continuous-time gradient ascent flow of the multicenter function 7i a rea,a, 

Pi- n out (q)4>(q)dq, i€{l,...,n}, 

JVi(V) n9S( Pi ,a) 

where n ou t is the outward normal vector to the ball B(pi,a). 

(i) What are the equilibrium points? 

(ii) Show that "Warea.a is monotonically non-decreasing along the flow. 

(iii) Show that the set S is invariant, i.e., that the trajectories of all nodes 
remain in S. 

(iv) Use (i-)-(iii) to apply the LaSalle fnvariance Principle and show that 
the solutions of the flow converge to the set of a-limited area-centered 
Voronoi configurations in S. 

(v) Implement numerically the flow in the software of your choice. Select the 
unit square S — [0, f] x [0, 1], the density function 

cj>{x, y) = exp ( - {x - -) 2 - (y - -) 2 J + exp ( - (x - -) 2 - (y - -) 
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and the parameter a — |. Run simulations from different initial con- 
ditions and with different numbers of nodes. Show by illustration that 
multiple local maxima exist. 
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Chapter Three 

Robotic network models and complexity notions 



This chapter introduces the main subject of study of this book, namely a 
model for groups of robots that sense their own position, exchange messages 
according to a geometric communication topology, process information, and 
control their motion. We refer to such systems as robotic networks. The 
content of this chapter has evolved from Martinez et al. (2007a). 

The chapter is organized as follows. The first section contains the for- 
mal model. We begin by presenting the physical components of a network, 
that is, the mobile robots and the communication service connecting them. 
We then present the notion of control and communication law, and how a 
law is executed by a robotic network. These notions subsume the notions 
of synchronous network and distributed algorithm described in Section 1.5. 
As an example of these notions, we introduce a simple law, called the agree 
and pursue law, which combines ideas from leader election algorithms and 
from cyclic pursuit (i.e., a game in which robots chase each other in a cir- 
cular environment). In the second section, we propose a model of groups of 
robots that interact through sensing, rather than communication. The third 
section discusses time, space, and communication complexity notions for 
robotic networks as extensions of the corresponding notions for distributed 
algorithms. The complexity notions rely on the basic concept of coordina- 
tion task and task achievement. The fourth and last section establishes the 
time, space, and communication required by the agree and pursue law to 
steer a group of robots to a uniformly spaced rotating configuration. We 
end the chapter with three sections on, respectively, bibliographical notes, 
proofs of the results presented in the chapter, and exercises. 

3.1 A MODEL FOR SYNCHRONOUS ROBOTIC NETWORKS 

Here, we introduce a model for a synchronous robotic network. This model 
is an extension of the synchronous network model presented in Section 1.5.1. 
We start by detailing the physical components of the network, which include 
the robots themselves as well as the communication service among them. 
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3.1.1 Physical components 

We start by providing a basic definition of a robot and a model for how each 
robot moves in space. 

A mobile robot is a continuous-time continuous-space dynamical system 
as defined in Section 1.3, that is, a tuple (X, U,Xo, f), where 

(i) X is d-dimensional space chosen among R , § , and the Cartesian 
products R dl x S^ 2 , for some d\ + cfo = d, called the state space; 

(ii) U is a compact subset of R m containing m , called the input space; 

(iii) Xq is a subset of X, called the set of allowable initial states; and 

(iv) / : X x U — > R rf is a continuously differentiable control vector field 
on X, that is, / determines the robot motion x : R>o — > X via the 
differential equation, or control system, 

i(t) = /(x(t),n(t)), (3.1.1) 

subject to the control u : R>o — > U. 

We will use the terms "robot" and "agent" interchangeably. We refer to 
x G X and u G U as a physical state and an inpwi of the mobile robot, 
respectively. Most often, the physical state will have the interpretation 
of a location, or a location and velocity. We will often consider control- 
affine vector fields. In such a case, we represent / as the ordered family 
of continuously differentiable vector fields (/o, /i, . . . , f m ) on X. In general, 
the control signal u will not depend only on time but also on x and possible 
other variables in the system. Note that there is no additional difficulty in 
modeling mobile robots using dynamical systems defined on manifolds (Bullo 
and Lewis, 2004), but we avoid it here in the interest of simplicity. 

Example 3.1 (Planar vehicle models). The following models of control 
systems are commonly used in robotics, beginning with the early works 
of Dubins (1957), and Reeds and Shepp (1990). Figures 3.1(a) and (b) 
show a two-wheeled vehicle and a four-wheeled vehicle, respectively. The 
two-wheeled planar vehicle is described by the dynamical system 

x = vcos9, y = vsinO, = u>, (3.1.2) 

with state variables x G R, y G R, and 9 G S 1 , describing the planar position 
and orientation of the vehicle, and with controls v and u>, describing the 
forward linear velocity and the angular velocity of the vehicle. Depending 
on which set the controls are restricted to, we define the following models: 
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(a) (b) 

Figure 3.1 A two-wheeled vehicle (a) and four-wheeled vehicle (b). In each case, the 
orientation of the vehicle is indicated by the small triangle. 

The unicycle. The controls v and uj take value in [—1,1] and [—1,1], re- 
spectively. 

The differential drive robot. Set v = (u; r i g ht + wi e ft)/2 and ui = ( Wright — 
tt>ieft)/2 and assume that both bright and uj\ e ft take value in [—1, 1]. 

The Reeds— Shepp car. The control v takes values in { — 1,0, 1} and the 
control uj takes values in [—1,1]. 

The Dubins vehicle. The control v is set equal to 1 and the control uj 
takes value in [—1,1]. 



Finally, the four-wheeled planar vehicle, composed of a front and a rear axle 

separated by a distance £, is described by the same dynamical system (3.1.2) 

with the following distinctions: (x, y) £ R 2 is the position of the midpoint 

of the rear axle, 6 £ S 1 is the orientation of the rear axle, the control v is 

the forward linear velocity of the rear axle, and the angular velocity satisfies 

v 
uj = — tancj), where the control cf> is the steering angle of the vehicle. • 

Next, we generalize the notion of synchronous network introduced in Def- 
inition 1.38 and introduce a corresponding notion of robotic network. 

Definition 3.2 (Robotic network). The physical components of a robotic 
network S consist of a tuple (1, 1Z, B cmm ), where 

(i) I = {1, . . . ,n}, I is called the set of unique identifiers (UIDs); 
(ii) U = {R^jiei = {(X®,U®,X®,f®)} ieI is a set of mobile robots; 

(iii) -Bcmm is a map from Yii^i X 1° * ne subsets of / x / — this map is 
called the communication edge map. 
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Additionally, if all mobile robots are identical, that is, if By' = (X, U, Xq, f) 
for all i G {1, . . . , n}, then the robotic network is uniform. • 



Remarks 3.3 (Notational conventions and meaning of the commu- 
nication edge map). 

(i) Following the convention established in Section 1.5, we let the su- 
perscript [i] denote the variables and spaces which correspond to the 

robot with unique identifier i; for instance, x'- 1 ' G X*- 1 ' and x G Xq 
denote the physical state and the initial physical state of robot Ry' , 
respectively. We refer to x = {x' x \ . . . ,xt n J) G Iliej^ as a state 
of the network. 

(ii) The map x i— > (I, E cmm {x)) models the topology of the communica- 
tion service among the robots: at a physical state x = (x*- 1 ', . . . , x*- n '), 
two robots at locations x' 1 ' and x"' can communicate if and only if 
the pair (i,j) is an edge in E cmm (x) = E cmm (x W, . . . , x 1 ™'). Accord- 
ingly, we refer to (I,E cram (x)) as the communication graph at x. 
When and which robots communicate is discussed in Section 3.1.2. 
As communication graphs, we will often adopt one of the proximity 
graphs discussed in Section 2.2, and in particular the (undirected) 
disk graph. • 

To make things concrete, let us present some examples of robotic networks 
that will be commonly used later. 

Example 3.4 (First-order robots with range-limited communica- 
tion). Consider a group of robots moving in M. d , d > 1. As in Chapter 2, 
we let p denote a point in M. d and we let {pM , . . . , p*- n > } denote the robot 
locations. Assume that the robots move according to 

p®(t) = u®(t), (3.1.3) 

with vy' G [— u max , u max ] d ; for an illustration, see Figure 3.2. According to 
our mobile robot notation, these are identical robots of the form 

(R d , [-u max , u max ] d , R d , (0 d , e x , . . . , e d )). 

We assume that each robot can sense its own position and can communicate 
with any other robot within distance r, that is, we adopt the r-disk graph 
£?disk( r ) defined in Section 2.2 as communication graph. These data define 
the uniform robotic network 5disk- 

It will also be interesting to consider first-order robots with communi- 
cation graphs other than the disk graph; important examples include the 
Delaunay graph Qd, the limited Delaunay graph <?ld(0; an d the co-disk 
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Figure 3.2 An omnidirectional vehicle. In addition to controlling the rotation speed of 
the wheels, the vehicle can also actuate the direction in which they point. 
This allows the vehicle to move in any direction according to the first-order 
dynamics (3.1.3). 



graph Goo-disk{f), discussed in Section 2.2. These three graphs, adopted as 
communication models, give rise to three robotic networks denoted 5d, and 
Sld, <Soo-disk, respectively. • 

Example 3.5 (Planar vehicle robots with Delaunay communica- 
tion). We consider a group of vehicle robots moving in an allowable envi- 
ronment Q C I 2 according to the planar vehicle dynamics introduced in 
Example 3.1. We let {(pM, 6»W), . . . , (pM, 0M)} denote the robot physical 
states, where pW = (xW,yW) £ Q corresponds to the position and $<■*' £ S 1 
corresponds to the orientation of the robot i € I. As the communication 
graph, we adopt the Delaunay graph Q-q on Q introduced in Section 2.2. 
These data define the uniform robotic network 5 V ehicles- • 

Example 3.6 (Robots with line-of-sight communication). We con- 
sider a group of robots moving in an allowable environment QcR 2 . As in 
Example 3.4, we let {pM, . . . ,p^} denote the robot locations and we assume 
that the robots move according to the motion model (3.1.3). Each robot can 
sense its own position and the boundary of dQ, and can communicate with 
any other robot within distance r and within line of sight, that is, we adopt 
the range-limited visibility graph £/ v is-disk,<2 in Q defined in Section 2.2 as 
the communication graph. These data define the uniform robotic network 

'-'vis-disk' • 

Example 3.7 (First-order robots in S 1 ). Consider a group of n robots 
{0W, . . . ,#' n '} in S j moving along on the unit circle with an angular ve- 
locity equal to the control input. Each identical robot is described by the 
tuple (S 1 , [— u max , u max ], S 1 , (0, e)), where e is the vector field on S 1 describ- 
ing unit-speed counterclockwise rotation. As in the previous examples, we 
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assume that each robot can sense its own position and can communicate 
with any other robot within distance r along the circle, that is, we adopt 
the r-disk graph £/disk(?") on S 1 defined in Section 2.2 as the communication 
graph. These data define the uniform robotic network <S c i rc i e - • 

We conclude this section with a remark. 

Remark 3.8 (Congestion models in robotic networks). The behav- 
ior of a robotic network might be affected by communication and physical 
congestion problems. 

Communication congestion: Omnidirectional wireless transmissions in- 
terfere. Clear reception of a signal requires that no other signals are 
present at the same point in time and space. In an ad hoc network, 
node i receives a message transmitted by node j only if all other neigh- 
bors of i are silent. In other words, the transmission medium is shared 
among the agents. As the density of agents increases, so does wireless 
communication congestion. The following asymptotic and optimiza- 
tion results are known. 

First, for ad hoc networks with n uniformly randomly placed nodes, 
it is known (Gupta and Kumar, 2000) that the maximum-throughput 
communication range r(ri) of each node decreases as the density of 
nodes increases; in d dimensions, the appropriate scaling law is r(n) £ 
0((log(n)/n) 1 ' ). This is referred to as the connectivity regime in 
percolation theory and statistical mechanics. Using the A;-nearest- 
neighbor graph over uniformly placed nodes, the analysis in Xue and 
Kumar (2004) suggests that the minimal number of neighbors in a 
connected network grows with log(n). 

Second, a growing body of literature (Santi, 2005; Lloyd et al., 2005) 
is available on topology control, that is, on how to compute trans- 
mission power values in an ad hoc network so as to minimize energy 
consumption and interference (due to multiple sources), while achiev- 
ing various graph topological properties, such as connectivity or low 
network diameter. 

Physical congestion. Robots can collide: it is clearly important to avoid 
"simultaneous access to the same physical area" by multiple robots. 
It is reasonable to assume that, as the number of robots increases, so 
should the area available for their motion. A convenient alternative 
approach is the one taken by Sharma et al. (2007), where robots' safety 
zones decrease with decreasing robot speed. This suggests that, in a 
fixed environment, individual nodes of a large ensemble have to move 
at a speed decreasing with n, and in particular, at a speed proportional 
to n~ 1 ' d . Roughly speaking, if the overall volume V in which the 
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groups of agents move is constant, and there are n robots, then the 
speed v at which they can move goes approximately as v ~ ^. 

In summary, one way to incorporate congestion effects into the robotic 
network model is to assume that the parameters of the network physical 
components depend upon the number of robots n. In the limit as n — > +00, 
we will sometimes assume that r and u max , the communication range and 
the velocity upper bound in Examples 3.4 and 3.7, are of order n -1 ' . • 



3.1.2 Control and communication laws 

Here, we present a discrete-time communication, continuous-time motion 
model for the evolution of a robotic network subject to a communication 
and control law. In our model, each robot evolves in the physical domain 
in continuous time, senses its position in continuous time, and, in discrete 
time, exchanges information with other robots and executes a state machine, 
which we shall refer to as a processor. The following definition is a general- 
ization of the concept of distributed algorithm introduced in Definition 1.39 
and of the classical notion of dynamical feedback controller. 

Definition 3.9 (Control and communication law). A control and com- 
munication law CC for a robotic network <S consists of the sets: 

(i) A, a set containing the null element, called the communication 
alphabet — elements of A are called messages; 

(ii) W^\ i E I, called the processor state sets; and 
(iii) Wq C W^\ i E I, sets of allowable initial values; 

and of the following maps: 

(i) msgW : X*- l > x W™ x 7 -> A, i 6 /, called message-generation func- 
tions; 

(ii) stfW : X® x W® x A 71 -> W®, i 6 I, called (processor) state- 
transition functions; and 

(iii) ctl [l] : X® x X® x W® xA n ^ U®, % € I, called (motion) control 
functions. 

If S is uniform and if W® = W, msgW = msg, stP' = stf, and ctl^ = ctl, 
for all i € I, then CC is said to be uniform and is described by a tuple 
(A,W,{W^} ie j,msg,stf,ctl). 
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We will sometimes refer to a control and communication law as a dis- 
tributed motion coordination algorithm. Roughly speaking, the rationale 
behind Definition 3.9 is as follows (see Figure 3.3). The state of robot i in- 



Update 

processor 

state 




Figure 3.3 The execution of a control and communication law by a robotic network. 

eludes both the physical state x" £ X™ and the processor state io™ £ W^' 
of the state machine that robot i implements. These states are initialized 
with values in their corresponding allowable initial sets X and Wq . We 
assume that the robot can sense it own physical position x'- 1 '. At each time 
instant £ £ Z>o, robot i sends to each of its out-neighbors j in the com- 
munication digraph (I,E cram (x)) a message (possibly the null message) 
computed by applying the message-generation function msgM to the current 
values of its physical state x"' and processor state w^\ and to the identity 
j. Subsequently, but still at the time instant £ £ Z>o, robot i updates the 
value of its processor state ioM by applying the state-transition function stf^ 
to the current value of its physical state x™, processor state uM and to the 
messages it receives from its in-neighbors. Between communication instants, 
that is, for t £ [£, £ + 1) for some £ £ Z>o, the motion of the ith robot is 
determined by applying the control function to the current value of x^\ the 
value of x^' at time £, the current value of w", and the messages received at 
time £. This evolution model is very similar to the one that we introduced 
for synchronous networks in Definition 1.40: in each communication round, 
the first step is transmission and the second one is computation and, except 
for the dependence on the physical state x, the communication and state 
transition processes are identical. 

These ideas are formalized in the following definition. 

Definition 3.10 (Evolution of a robotic network). Let CC be a control 
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and communication law for the robotic network S. The evolution of (S, CC) 
from initial conditions x G Xq and w Q G Wq , ? G /, is the collection of 
curves xW : M> -> X^ and w^ : Z> -> W®, i G I, defined by 



where [t\ = maxjf G Z>o | £ < t}, and 

w M(£) = stfM(x®(e),w®(£-l),yW(£)), 

with a;W(0) = x and u>^( — 1) = u> , i G /. In the previous equations, j/W : 
Z>o — > A 71 (describing the messages received by processor i) has components 

Vj (£), for j G /, defined by 

y®m = f™E b XxW(i),wW(£-l),i), if (j,i) G E cmm ( x m (£),..., x^(£)), 
[null, otherwise. 



>j 



For convenience, we define w(t) = w(\t\) for all t G K>o, and let M>o 3 
t i— > (x(i),ty(i)) denote the curves a;W and iyW, for z G {1, . . . ,n}. 



Remarks 3.11 (Simplifications of control and communication laws). 

(i) A control and communication law CC is static if the processor state 
set W" is a singleton for all i G /. This means that there is no 
meaningful evolution of the processor state. In this case, CC can be 
described by a tuple (A, {msgW}j S /, {ctl"}i £ /), with msgW : X^ x 
I -► A, and ctl [i] : X® x XM xA"^ [7"M, for i G I. 

(ii) A control and communication law CC is data-sampled if the con- 
trol functions are independent of the current position of the robot 
and depend only upon the robot's position at the last sample time. 
Specifically, the control functions have the following property: given 
a processor state w'- 1 ' G W^\ an array of messages y^- 1 ' G A n , a cur- 
rent state x", and a state at last sample time x^ ld , the control 

input ctl^(xW,Xg' ld , u>W,yH) is independent of s", for all i € I. 
In this case, the control functions can be described by maps of the 
form ctl [i] : X® x W® xA n ^ U^\ for % G I. 

(iii) In many control and communication laws, the robots exchange full 
information about their states, including both their processor and 
their physical states. For such laws, we identify the communication 
alphabet with A = (X x W) U{null} and we refer to the corre- 
sponding message-generation function msg std (x , w , j) = (x,w) as 
the standard message-generation function. 
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Note that we allow the processor state set and the communication alphabet 
to contain an infinite number of symbols. In other words, we assume that a 
robot can store and transmit a (finite number of) integer and real numbers, 
among other things. This is equivalent to assuming that we neglect any 
inaccuracies due to quantization, as we did in Section 1.6. • 

Remark 3.12 (Extensions of control and communication laws). 

Here, we briefly discuss alternative models and extensions of the proposed 
models. 

Asynchronous sensor-based interactions. In the early network model 
proposed by Suzuki and Yamashita (1999), robots are referred to as 
"anonymous" and "oblivious" in precisely the same way in which we 
defined control and communication laws to be uniform and static, re- 
spectively. As compared with our notion of robotic network, the model 
in Suzuki and Yamashita (1999) is more general in that the robots' ac- 
tivation schedules do not necessarily coincide (i.e., this model is asyn- 
chronous), and at the same time it is less general in that (1) robots 
cannot communicate any information other than their respective po- 
sitions, and (2) each robot observes every other robot's position (i.e., 
the complete communication graph is adopted). In the Section 3.2 
below, we present a model in which robots rely on sensing rather than 
communication for their interaction. 

Discrete-time motion models. For some algorithms in later chapters, it 
will be convenient to consider discrete-time motion models; for exam- 
ple, we present discrete-time motion models for first-order agents in 
Section 4.1. In some other cases, it will be convenient to consider dy- 
namical interactions between agents taking place in continuous time. 

Stochastic link models. Although we do not present any results on this 
topic in this notes, it is possible to develop robotic networks models 
over random graphs and random geometric graphs, as studied by Bol- 
lobas (2001) and Penrose (2003). Furthermore, it is of interest to 
consider communication links with time-varying rates. • 



3.1.3 The agree and pursue control and communication law 

We conclude this section with an example of a dynamic control and com- 
munication law. The problem is described as follows: a collection of robots 
with range-limited communication are placed on the unit circle; the robots 
move and communicate with the objectives of (1) agreeing on a direction of 
motion (clockwise or counterclockwise) and (2) achieving an equidistant con- 
figuration where all robots are equally angularly spaced. To achieve these 
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two objectives, we combine ideas from leader election algorithms for syn- 
chronous networks (see Section 1.5.4) and from cyclic pursuit problems (see 
Exercise El. 30): the robots move a distance proportional to an appropriate 
inter-robot separation, and they repeatedly compare their identifiers to dis- 
cover the direction of motion of the robot with the largest identifier. In other 
words, the robots run a leader election task in their processor states and a 
uniform robotic deployment task in their physical state — these are among 
the most basic tasks in distributed algorithms and cooperative control. We 
present the algorithm here and characterize its correctness and performance 
later in the chapter. 

From Example 3.7, we consider the uniform network 5 c ; rc i e of locally con- 
nected first-order robots on S 1 . For r, u ma , x , k prop 6 ]0, |[ with k pmp r < u max , 
we define the agree & pursue law, denoted by CC AGREE & PURSUE , as the 
uniform data-sampled law loosely described as follows: 

[Informal description] The processor state consists of dir (the 
robot's direction of motion) taking values in {c, cc} (meaning 
clockwise and counterclockwise) and max-id (the largest UID 
received by the robot, initially set to the robot's UID) taking 
values in I. In each communication round, each robot transmits 
its position and its processor state. Among the messages received 
from agents moving toward its position, each agent picks the 
message with the largest value of max-id. If this value is larger 
than its own value, the agent resets its processor state with the 
selected message. Between communication rounds, each robot 
moves in the clockwise or counterclockwise direction depending 
on whether its processor state dir is c or cc. Each robot moves 
&prop times the distance to the immediately next neighbor in the 
chosen direction, or, if no neighbors are detected, fc pr0 p times the 
communication range r. 

Note that the processor state with the largest UID will propagate through- 
out the network as in the floodmax algorithm for leader election. Also, 
note that the assumption k pTop r < tt max guarantees that the desired control 
is always within the allowable range [— u max , Wmax]- Next, we define the law 
formally: 

Robotic Network: 5 c i rc i e , first-order agents in S 1 

with absolute sensing of own position, and 
with communication range r 

Distributed Algorithm: AGREE & PURSUE 
Alphabet: A = S 1 x {c, cc} x /U{null} 
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Processor State: w = (dir,max-id), where 

dir 6 {c,cc}, initially: dir^ unspecified 

max-id £ 7", initially: max-id^ = i for all i 

% Standard message-generation function 
function msg(6,w,i) 
l: return (9,w) 

function stf(0, w, y) 

l: for each non-null message (# rcv d> (dir rcv d,max-id rcv d)) m V do 

2: if (max-id rcv( j > max-id) AND (dist cc (0, # r cvd) < r AND dir rcv d 

c) OR (dist c (0, ^ rC vd) < r AND dir rcv( j = cc) then 
3: new-dir := dir rcv( j 

4: new-id := max-id rcv( j 

5: return (new-dir, new-id) 



function ct\(9 smp \ d ,w,y) 

1: dtmp ■= T 

2: for each non-null message (# r cvd> (dir rcvc j,max-id rcvc i)) in y do 
3: if (dir = cc) AND (dist C c(0 S mpid> 6» rcvd ) < dtmp) then 

4: d tmp := dist cc (^ smp id,^rcvd) 

5: "Wtmp ■ — "-propOtmp 

6: if (dir = c) AND (dist c (r? smpld , 9 rcvd ) < d tmp ) then 

7: dtmp := dist c (^ smp id, # rC vd) 

8 ; "tmp • — "-prop^tmp 

9: return Utmp 

An implementation of this control and communication law is shown in 
Figure 3.4. As parameters, we select n = 45, r = 27r/40, u max = 1/4 and 
^prop = 7/16. Along the evolution, all robots agree upon a common direction 
of motion and, after a suitable time, they reach a uniform distribution. 




Figure 3.4 The AGREE & PURSUE law. Red-colored disks and blue-colored circles cor- 
respond to robots moving counterclockwise and clockwise, respectively. The 
initial positions and the initial directions of motion are randomly generated. 
The five diagrams depict the state of the network at times 0, 9, 20, 100, and 
800. 



148 



"Distributed Control of Robotic Networks" by F. Bullo, J. Cortes and S. Martinez 
Copyright © 2006-2009. Manuscript under contract. This version: March 22, 2009 



DCRN March 22, 2009 



3.2 ROBOTIC NETWORKS WITH RELATIVE SENSING 

The model presented above assumes the ability of each robot to know its own 
absolute position. Here, we treat the alternative setting in which the robots 
do not communicate amongst themselves, but instead detect and measure 
each other's relative position through appropriate sensors. Additionally, 
we assume that the robots will perform measurements of the environment 
without having any a priori knowledge of it. We assume that robots do not 
have the ability to perform measurements expressed in a common reference 
frame. An early reference in which relative information is adopted is Lin 
et al. (2005). 



3.2.1 Kinematics notions 

Because the robots do not have a common reference frame, all the measure- 
ments generated by their on-board sensors are expressed in a local reference 
frame. To formalize this fact, it is useful to review some basic kinematics 



conventions. We let £ 



fixed 



(P 



fixed 



/™fixed fixed 



z }) be a fixed refer- 



ence frame in R . A point q, a vector v, and a set of points S expressed 
with respect to the frame £ fixed are denoted by q&xed, ffixed and Sfixed, re- 
spectively Next, let £ = (p , {x , y , z }) be a reference frame fixed to 



?b 



9fixed" 



Pfixed .- 




*** fixed 



Figure 3.5 Inertially fixed and body-fixed frames in R 3 . 

a moving body. The origin of S b is the point p h , denoted by Pg xed when 
expressed with respect to S fixed . The orientation of S b is characterized by 
the d-dimensional rotation matrix i?g xed , whose columns are the frame vec- 
tors {x h ,y h ,z h } of S b expressed with respect to £ fixed . We recall here the 
definition of the group of rotation matrices in d-dimensions: 



SO(d) = {R e 



ixd 



RR 



T 



I d , det(fl) = +1}. 



149 



"Distributed Control of Robotic Networks" by F. Bullo, J. Cortes and S. Martinez 
Copyright © 2006-2009. Manuscript under contract. This version: March 22, 2009 



DCRN March 22, 2009 



With these notations, changes of reference frames are described by 

(/fixed = -Rfixed<7b + Pfixed; 
^fixed = Rft x ed V bi 



Sfixed — -Rfixed'S'b + Pfixed- 



(3.2.1) 



Note that these change-of-frames formulas also hold in the planar case with 
the corresponding definition of the rotation matrix in SO(2). 

Remark 3.13 (Comparison with literature). In our notation, the sub- 
script denotes the frame with respect to which the quantity is expressed. 
Other references in the literature sometimes adopt the opposite convention, 
in which the superscript denotes the frame with respect to which the quan- 
tity is expressed. • 



3.2.2 Physical components 

In what follows, we describe our notion of mobile robots equipped with rel- 
ative sensors. We consider a group of n robots moving in an allowable 
environment Q C Mr, for d 6 {2,3}, and we assume that a reference frame 
£'*], for i 6 {1, . . . , n}, is attached to each robot (see Figure 3.6). Expressed 
with respect to the fixed frame E , the ith frame S^ is described by a 
position p^ed e ^ an d an orientation i%x e( j £ SO(d). The continuous-time 
motion and discrete-time sensing models are described as follows. 





lj* 





Figure 3.6 A robotic network with relative sensing. A group of four robots moves in R . 
Each robot i £ {1, ... ,4} has its own reference frame E'*'. 



Motion model: We select a simple motion model: for all t £ M>o, the 
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orientation -Rg^ed ^ s cons tant in time and robot i translates according to 

pL d (t) = R [ L d uf l , (3.2.2) 

that is, the ith control input u\ is known and applied in the robot frame. 

Each control input u- , i £ {l,...,n}, takes values in a compact input 
space U. Clearly, it would be possible to consider a motion model with 
time- varying orientation and we refer the reader to Exercise E3.1, where we 
do so. 

Sensing model: At each discrete time instant, robot i activates a sensor 
that detects the presence and returns a measurement about the relative po- 
sition of any object (robots or environment boundary) inside a given "sensor 
footprint." We describe the model in two steps. First, each robot measures 



r 



y fixed 





fixed "^ , 



Sl'l 



(a) 



(b) 



Figure 3.7 Examples of sensor footprints, (a) The cone-shaped sensor footprint of a vehicle 
equipped with a camera, (b) The 270-degree wedge-shaped sensor footprint of 
a vehicle equipped with a laser scanner. 

other robots' positions and the environment as follows. 



Sensing other robots' positions. There exists a set A r bt containing the 
null element, called the sensing alphabet, and a map rbt-sns : M — > 
A r bt, called the sensing function, with the interpretation that robot i 



acquires the symbol rbt-sns (p 
{i}. 



L/1 - 



:v r bt for each robot j £ {1, . . . , n} \ 



Sensing the environment. There exists a set A env containing the null 
element, called the environment sensing alphabet, and a map env-sns : 
P(R ) — > A env , called the environment sensing function, with the in- 
terpretation that robot i acquires the symbol env-sns (Qi) £ A env . 
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Second, we let S'- 1 ' C R be the sensor footprint of robot i and we let 
S\ be its expression in the frame E^ (see Figure 3.7). For simplicity, we 

assume that all robot sensors are equal, so that we can write o • = S. We 
require both sensing functions to provide no information about robots and 
boundaries that are outside S in the following two meanings: (i) if p is any 
point outside S, then rbt-sns(p) = null; and (ii) if W is any subset of M. d , 
env-sns(W) = env-sns(W n S). 

We summarize this discussion with the following definition. 

Definition 3.14 (Network with relative sensing). The physical com- 
ponents of a network with relative sensing consist of n mobile robots with 
identifiers {1, . . . , n}, with configurations in Q x SO(d), for an allowable en- 
vironment Q C R , with dynamics described by equation (3.2.2), and with 
relative sensors described by the sensor footprint S, sensing alphabets A rD t 
and Aenv, and sensing functions rbt-sns and env-sns. • 

To make things concrete, let us present two examples of robotic networks 
with relative sensing that are analogs of the "communication-based" robotic 
networks 5disk and 5 v is-disk hi Examples 3.4 and 3.6. 

Example 3.15 (Disk sensor and corresponding relative-sensing net- 
work). Given a sensing range r £ R>o, the disk sensor has sensor footprint 
B(Qd, r), that is, a disk sensor measures any object (robot and environment 
boundary) within distance r. Regarding sensing of other robots, we assume 
that the alphabet is A r bt = R Ujnull} and that the sensing function is 
rbt-sns (pf ) = pf for each robot j £ {1, . . . ,n}\ {i}, inside the sensor foot- 
print B(0d,r), and rbt-sns (pf ) = null, otherwise. Regarding sensing of 
the environment, we assume that the alphabet is A env = P(R ) and that the 
sensing function is env-sns(<5i) = Qi nB(0d, r). A group of robots with disk 

^rs 
'disk' 



sensors defines the robotic network with relative sensing 5jf_,. 



Example 3.16 (Range-limited visibility sensor and corresponding 
relative-sensing network). Given a sensing range r £ R>o> the range- 
limited visibility sensor has sensor footprint B(0d, r) and performs measure- 
ments only of objects within unobstructed line of sight. Regarding sensing 
of other robots, we assume that the alphabet is A r t,t = R rf U{null} and that 
the sensing function is rbt-sns (pf ) = pf for each robot j E {1, . . . , n}\ {i}, 

inside the range-limited visibility set Vi<iisk(02; Qi), and rbt-sns (pf ) = null, 
otherwise. Regarding sensing of the environment, we assume 1 that the al- 
phabet is A env = P(R rf ) and that the environment sensor measures the range- 



1 lt would be equivalent to assume that the robot can sense every portion of dQ that is within 
distance r and that is visible from the robot's position. 
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limited visibility set Vidisk(Pftx ec i> ^) expressed with respect to the frame S^; 
for the definition of range- limited visibility set, see Section 2.1.2. In other 
words, the environment sensing function is env-sns(Qj) = Vid; s k(02; Qi)- 
This is illustrated in Figure 3.8. A group of robots with range-limited visi- 





Figure 3.8 The left-hand plot depicts the range-limited visibility set Vidisk(Pfli e< ji Q) ex ~ 
pressed with respect to an inertially fixed frame. The right-hand plot de- 
picts the range-limited visibility set expressed with respect to the body-fixed 
frame £ w , that is, Vidi S k(02; Qi)- 



bility sensors defines the robotic network with relative sensing 5. 



rs 
vis-disk ' 



Remark 3.17 (Sensing model consequences). The proposed sensing 
model has the following two consequences: 

(i) Robots have no information about the absolute position and orienta- 
tion of themselves, the other robots or any part of the environment. 

(ii) The relative sensing capacity of the robots gives rise to a proximity 
graph, called the sensing graph, whose edges are the collection of 
robot pairs that are within sensing range. For example, in the net- 
work 5j; sk , the sensing graph is the disk graph (?disk(0- I n general, 
sensing graphs are directed. • 



3.2.3 Relative-sensing control laws 

As we did for robotic networks with interactions based on communication, 
we define here control laws based on relative sensing and we describe the 
closed-loop evolution of robotic networks with relative sensing. 

First, we consider a robotic network with relative sensing 5 rs characterized 
by: identifiers {l,...,n}, configurations in Q x SO(d), for an allowable 
environment Q C M d , dynamics described by equation (3.2.2), and relative 
sensors described by the sensor footprint S, sensing alphabets A r bt and 
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A env , and sensing functions rbt-sns and env-sns. A relative- sensing control 
law 1ZSC for the robotic network with relative sensing S TS consists of the 
following tuple: 

(i) W, called the processor state set, with a corresponding set of allow- 
able initial values Wq C W; 

(ii) stf : W x A™ bt x A env — > W, called the (processor) state-transition 
function; and 

(hi) ctl : W X A™ bt x A env — * U, called the (motion) control function. 

As for robotic networks, we say that 1ZSC is static if W is a singleton for 
all i G {1, . . . , n}; in this case, 7ZSC can be described by a motion control 
function ctl : A™ bt x A env — > [/. Additionally, if the environment Q = M d , 
then 7£<SC can be described by a motion control function ctl : W x A™ bt — > [/. 

Second, the evolution of (S TS ,1ZSC) from initial conditions (Po ; -^fixed) e 
IR ' x SO(d) and w G Wo, i G {1, . . . , n} is the collection of curves pj^ed ' 
M>0 -» M d and u>M : Z> -»• W, * G {1, . . . , n}, defined by 

u;HW = stf( U ;W(^-l),yHW,y|iW), 

with Pgxed(^) = Po an< ^ ^ ( — 1) = Wq \j i G {l,...,n}. In the previous 
equations, y'- 1 ' : Z>o — > A™ bt (describing the robot measurements taken by 

sensor i) with components y* (£), for j G {1, . . . , n}, and j/env : ^>o - * A en v 
(describing the environment measurements taken by sensor i) are defined by 

yf {£) = rbt-sns(p| i] (£)), y^ v (£) = env-sns(Q^)). 

In the last equation, p^ and Qi {£) denote the position of the j-th robot and 
the environment Q as expressed with respect to the moving frame SW. 



3.2.4 Equivalence between control and communication laws and relative- 
sensing control laws 

Consider a "communication-based" robotic network S\ with a control and 
communication law CC\ with the following properties: 

(i) Regarding S\\ the network is uniform, the state space is X = M. 
with states denoted by x^' = p^\ the communication graph is the 
r-disk graph, and the robot dynamics are p" = ii} 1 ' . 

(ii) Regarding CC\: the control and communication law is uniform and 
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data-sampled, the communication alphabet is A = 1 Ujnull}, and 
the message-generation function is msg(p, w,j) = p. 

Given a network and a law (Si,CC\) satisfying (i) and (ii), the control 
and communication law CC\ is invariant if its state transition and control 
maps satisfy, for all p G M. d , w G W, y G A n , and R G SO(d), 

stf(p, to, y) = stf (0 d , io, i?(y - p)) , 

ctl(p, to, y) = R T ctl(0 d , w, R(y - p)) , 

where the ith component of R(y — p) G A ra is R{y% — p) if y% G M rf , or null 
if yi = null. 

Next, consider a relative-sensing network £2 with disk sensors as in Exam- 
ple 3.15, that is, assume that the sensing footprint is B(0 d ,r), the sensing 
alphabet is A r bt = M rf U{null}, and the sensing function equals the identity 
function in B(0 d , r). We assume no environment sensing as we set Q = M. d . 
The communication and control law CC\ and the relative-sensing control law 
IZSC2 for network £2 are equivalent if their processor state sets identical, for 
example, denoting both by W, and their state transition and control maps 
satisfy, for all w G W and y G R d U{null} = A" = A" bt , 

stfi(0 d ,w,y) = st£ 2 (w,y), and ctli(0 d ,w,y) = ct\ 2 (w,y). 



Proposition 3.18 (Evolution equivalence). If CC\ is invariant and if 
CC\ and "R,SC<i are equivalent, then the evolutions of the control and com- 
munication laws (S\,CCi) and {S2,TZSC2) from identical initial conditions 
are identical. 

Proof. Assume that the messages and measurements array y^'(t) received 
by the i-th robot at time t in the communication-based network and in the 
relative-sensing networks are equal to, respectively: 

Jii] b'*l aTir i Jii] Jjk] 

Pfixed' • • ' ' -Pfixed' anCl Pi >■■■■> Pi ■ 

Under this assumption, the evolutions of the communication-based network 
and of the relative-sensing networks are written, respectively, as, 

AH _ rt-liCn^ 7i) M n [jl] n [jk] ) 

/'fixed — cu H/'fixed' w '/'fixed' ■ ■ ' '/'fixed/' 

A*l _ pW ct ] ( w li\ D b'i] D b'*h 

/'fixed — - ft fixed Cli 2l u; 'Pi '■■■'Pi )■ 

From equation (3.2.1), we know that, for all j G {ji, . . . , jk}, 

Ai\ _dW \J] , M = v _b']_/pM yzv bl _ W \ 

/'fixed — rl fixed/'i ^ /'fixed ^^ / j j — ^fixed^ 1 ^fixed /'fixed/- 
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From this equality and from the fact that CC\ is invariant, we observe that 

Since CC\ and IZSC2 are equivalent, the two evolution equations coincide. 
A similar reasoning also shows that the evolutions of the processor states 
are identical. ■ 

Remark 3.19 (Communication-based laws on relative-sensing net- 
works). Proposition 3.18 implies the following fact. An invariant control 
and communication law for a robotic network satisfying appropriate prop- 
erties can be implemented on an appropriate relative-sensing network as a 
relative-sensing control law. • 

3.3 COORDINATION TASKS AND COMPLEXITY NOTIONS 

In this section, we introduce concepts and tools that are useful analyzing 
a communication and control law in a robotic network; our treatment is 
directly generalized to relative-sensing networks. We address the following 
questions: What is a coordination task for a robotic network? When does a 
control and communication law achieve a task? And with what time, space, 
and communication complexity? 



3.3.1 Coordination tasks 

Our first analysis step is to characterize the correctness properties of a com- 
munication and control law. We do so by defining the notions of task and 
of task achievement by a robotic network. 

Definition 3.20 (Coordination task). Let S be a robotic network and 
let W be a set. 

(i) A coordination task is a map T: Yii^i X x W n — > {true, false}. 

(ii) If W is a singleton, then the coordination task is said to be static 
and can be described by a map T: Yliel -^ ~ * {"true, false}. 

Additionally, let CC be a control and communication law for S: 

(i) The law CC is compatible with the task T : U ieI X^ x W n -> 
{true, false} if its processor state takes values in W, that is, if 
W® = W, for all i G I. 

(ii) The law CC achieves the task Tif it is compatible with it and if, for 
all initial conditions x Q G Xq and w G Wq , i G I, there exists 
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T G K>o such that the network evolution t h- > (x(£),u;(£)) has the 
property that T(x(t), w(t)) = true for all t > T. • 

Remark 3.21 (Temporal logic). Loosely speaking, the phrase "a law 
achieves a task" means that the network evolutions reach (and remain at) 
a specified pattern in the robot physical or processor state. In other words, 
the task is achieved if at some time and for all subsequent times, the pred- 
icate evaluates to true along system trajectories. It is possible to consider 
more general tasks based on more expressive predicates on trajectories. Such 
predicates can be defined through various forms of temporal and proposi- 
tional logic, (see, e.g., Emerson, 1994). In particular, (linear) temporal logic 
contains certain constructs that allow reasoning in terms of time and is hence 
appropriate for robotic applications — as argued, for example, by Fainekos 
et al. (2005). Network tasks such as periodically visiting a desired set of 
configurations can be encoded with temporal logic statements. • 

Example 3.22 (Direction agreement and equidistance tasks). From 
Example 3.7, consider the uniform network 5 c i rc i e of locally connected first- 
order agents in S 1 . From Section 3.1.3, recall the agree & pursue control 
and communication law CC AGREE & pursue with processor state taking values 
in W = {cc, c} x I. There are two tasks of interest. First, we define the 
direction agreement task T dir : (S 1 ) 71 x W n — > {true, false} by 

ftrue, if dirW = • • • = dirW, 



T dir (6,w) 



[false, otherwise, 



where = (0M, . . . , 0M), w = (^M, . . . )U >M), and to W = (dir^.max-idW), 
for i & I. Furthermore, for e > 0, we define the static (agent) equidistance 
task ^-eqdstnc : (S 1 )™ — > {true, false} to be true if and only if 

| mindist c (0 [i] , b1 ) - mindist cc (0 [i] , L?1 )| < e, for all i G I. 

In other words, 7j_ eq d s tnc is true when, for every agent, the distances to the 
closest clockwise neighbor and to the closest counterclockwise neighbor are 
approximately equal. • 



3.3.2 Complexity notions 

We are now ready to define the notions of time, space and communication 
complexity. These notions describe the cost that a certain control and com- 
munication law incurs while completing a certain coordination task. Addi- 
tionally, the complexity of a task is the infimum of the costs incurred by all 
laws that achieve that task. We begin by highlighting a difference between 
what follows and the complexity treatment for synchronous networks. 

157 



"Distributed Control of Robotic Networks" by F. Bullo, J. Cortes and S. Martinez 
Copyright © 2006-2009. Manuscript under contract. This version: March 22, 2009 



DCRN March 22, 2009 



Remark 3.23 (Termination via task completion). As discussed in Re- 
mark 1.44 in Section 1.5, it is possible to consider various algorithm termi- 
nation notions. Here, we will establish the completion of an algorithm as 
the instant when a given task is achieved. • 

First, we define the time complexity of an achievable task as the minimum 
number of communication rounds needed by the agents to achieve the task T. 

Definition 3.24 (Time complexity). Let S be a robotic network and let 
Tbe a coordination task for S. Let CC be a control and communication law 
for S compatible with T: 

(i) the (worst-case) time complexity to achieve T with CC from initial 

conditions (x ,w ) G Ilje/^o x ILe/ w o is 

TC(T,CC,x ,w ) =w£{£\ T(x(k),w{k)) = true , for all k > £}, 

where t \— > (x(t),w(t)) is the evolution of (S, CC) from the initial 
condition (xo,u>o); 

(ii) the (worst-case) time complexity to achieve T with CC is 

TC(T,CC) = sup {tC(T,CC,x ,w ) | (x ,w ) e ]jx^ x]jw^}; 

(iii) the (worst-case) time complexity of T is 

TC(T) = inf{TC(7; CC) | CC compatible with 7). • 



Next, we quantify memory and communication requirements of commu- 
nication and control laws. We assume that elements of the processor state 
set W or of the alphabet set A might amount to multiple "basic memory 
units" or "basic messages." We let iWjbasic and |A|basic denote the number 
of basic memory units and basic messages required to represent elements 
of W and A, respectively. The null message has zero cost. To clarify this 
assumption, we adopt two conventions. First, as in Section 1.5.2, we assume 
that a "basic memory unit" or a "basic message" contains log(n) bits. This 
implies that the log(n) bits required to store or transmit a robot identifier 
i G {1, . . . , n} are equivalent to one "basic memory unit." Second, as men- 
tioned in Remark 3.11, we assume that a processor can store and transmit 
a (finite number of) integer and real numbers, and we adopt the convention 
that any such number is quantized and represented by a constant number 
of basic memory units or basic messages. 

We now quantify memory requirements of algorithms and tasks by count- 
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ing the required number of basic memory units. Let the network S, the task 
T, and the control and communication law CC be as in Definition 3.24. 

Definition 3.25 (Space complexity). 

(i) The (worst-case) space complexity to achieve T with CC, denoted 
by SC(TJCC), is the maximum number of basic memory units re- 
quired by a robot processor executing the CC on S among all robots 
and among all allowable initial physical and processor states until 
termination; and 

(ii) the space complexity of Tis the infimum among the space complex- 
ities of all control and communication laws that achieve T. • 

The set of all non-null messages generated during one communication 
round from network state (x,w) is denoted by 

M(x,w) = {(i,j) G E cmm (x) | msg [ii (x [i] , w®,j) + null}. 

We now quantify the mean and total communication requirements of algo- 
rithms and tasks by counting the number of transmitted basic messages. 

Definition 3.26 (Mean and Total Communication complexity). 

(i) The (worst-case) mean communication complexity and the (worst- 
case) total communication complexity to achieve T with CC from 

(xq,w ) € Uiei X o x llie/^0 are ' respectively, 

MCC(ZCC,x ,w )= l -^^y2\M(x(£),w(£))\, 

e=o 

r-l 

TCC(T,CC,x ,w ) = \A\ hasic J2\Mx(t),w(£))\, 

e=o 

where t \— > (x(t),w(t)) is the evolution of (S,CC) from the initial 
condition (xq,wo) and where r = TC(CC,T, xq, wo). Here, MCC is 
defined only for initial conditions (xq,wo) with the property that 
T(xo,wq) = false; 

(ii) the (worst-case) mean communication complexity (resp. the (worst- 
case) total communication complexity) to achieve Twith CC is the 
supremum of MCC(T,CC, xq, wo) (resp. TCC(T,CC,xo,wq)) overall 
allowable initial states (xo,wq); and 

(iii) the (worst-case) mean communication complexity (resp. the worst- 
case total communication complexity) of T is the infimum among 
the mean communication complexity (resp. the total communication 
complexity) of all control and communication laws achieving T. • 
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By construction, one can verify that it always happens that 

TCC(T,CC) < MCC(^CC) ■ TC(T,CC). (3.3.1) 

We conclude this section with possible variations and extensions of the com- 
plexity definitions. 

Remark 3.27 (Infinite-horizon mean communication complexity). 

The mean communication complexity MCC measures the average cost of the 
communication rounds required to achieve a task over a finite time horizon; 
a similar statement holds for the total communication complexity TCC. One 
might be interested in a notion of mean communication complexity required 
to maintain the task true for all times. Accordingly, the infinite-horizon 
mean communication complexity of CC from initial conditions (xq,wq) is 



IH-MCC(CC,x ,u;o)= lim I l basic V" \M(x(£), w(£))\. 



e=o 



Remark 3.28 (Communication complexity in omnidirectional net- 
works). In omnidirectional wireless networks, the standard operation mode 
is for all neighbors of a node to receive the signal that it transmits. In other 
words, the transmission is omnidirectional rather than unidirectional. It 
is straightforward to require the message-generation function to have the 
property that the output it generates be independent of the intended re- 
ceiver. Under such assumptions, it make sense to count as communication 
complexity not the number of messages transmitted in the network, but the 
number of transmissions, that is, a unit cost per node rather than a unit 
cost per edge of the network. • 

Remark 3.29 (Energy complexity). Given a model for the energy con- 
sumed by the robot to move and to transmit a message, one can easily 
define a notion of energy complexity for a control and communication law. 
In modern wireless transmitters, the energy consumption in transmitting a 
signal at a distance r varies with a power of r. Analogously, energy con- 
sumption is an increasing function of distance traveled. We consider this to 
be a promising avenue for further research. • 



3.3.3 Invariance under rescheduling 

Here we discuss the invariance properties of time and communication com- 
plexity under the rescheduling of a control and communication law. The 
idea behind rescheduling is to "spread" the execution of the law over time 
without affecting the trajectories described by the robots. 
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For simplicity we consider the setting of static laws; similar results can 
be obtained for the general setting. Also, for ease of presentation, we al- 
low our communication and control laws to be time dependent, that is, we 
consider message-generation functions and motion control functions of the 
form msgW : Z> x X® x I -> A and ctl [l] : R> x X® x X® x A™ -> J/M, 
respectively. Definition 3.10 for network evolution can be readily extended 
to this more general time-dependent setup. 

Let S = (I,7Z, E cmra ) be a robotic network in which each robot is a drift- 
less control system (see Section 1.3). Let CC = (A, {msgM}j e j, {ctl^jjg/) 
be a static control and communication law. In what follows, we define a 
new control and communication law by modifying CC; to do so, we intro- 
duce some notation. Let s G N, with s < n, and let Vi = {Iq, . ■ . , I s -i} De 
an s-partition of I, that is, Iq,...,I s -\ C / are disjoint and nonempty 
and I = U^,~ ifc- For i G I, define the message-generation functions 

msg^ : Z> x X® x I -► A by 

msg^^x, i) = msgW(^/sJ ,x, j), (3.3.2) 

fil 
if i G Ik and k = £ mod s, and msgp (£,x,j) = null otherwise. According 

to this message- generation function, only the agents with a unique identifier 

in 1^ will send messages at time £, where £ G {k + as} ag 2> - Equivalently, 

this can be stated as follows: according to (3.3.2), the messages originally 

sent at the time instant £ are now rescheduled to be sent at the time instants 

F(£)-s + l, . . .,F(£), where F : Z> -> Z> is defined by F{£) = s{£+l)-l. 

Figure 3.9 illustrates this idea. For i E I, define the control functions 




Figure 3.9 Under the rescheduling, the messages that are sent at the time instant I under 
the control and communication law CC are rescheduled to be sent over the 
time instants F(t) — s + 1, . . . , F(£) under the control and communication law 

cc (s , Pj) . 

c# ] : M>o x X® x XW xA"^ U® by 

ctl^(t, x,x smp \ d ,y) = ctl w (t-£ + F~ 1 (£),x,x smp \ d ,y) , (3.3.3) 

if t G [£,£+ 1] and £ = — 1 mod s, and ctlp (t,x,x smp \d,y) = otherwise. 
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Here, F' 1 : Z> -> Z> is the inverse of F, defined by F' 1 ^) = ^±1 - 1. 

Roughly speaking, the control law ctLp makes the agent i wait for the time 
intervals [£, £+1], with £ G {as — l} a eN> to execute any motion. Accordingly, 
the evolution of the robotic network under the original law CC during the 
time interval [£, £ + 1] now takes place when all the corresponding messages 
have been transmitted, that is, along the time interval [F(£), F(£) + 1]. The 
following definition summarizes this construction. 

Definition 3.30 (Rescheduling of control and communication laws). 

Let S = (I,TZ,E cmm ) be a robotic network with driftless physical agents, 
and let CC = (Z>o, A, {msg^}j S j, {ctl^}j S j) be a static control and commu- 
nication law. Let s G N, with s < n, and let Vj be an s-partition of I. The 
control and communication law CCu^y^ = (Z>o,A, {msgip }j e j,{ctLp }jgj) 
defined by equations (3.3.2) and (3.3.3) is called a 7>i -rescheduling of CC. • 

The following result, whose proof is presented in Section 3.6.1, shows that 
the total communication complexity is invariant under rescheduling. 

Proposition 3.31 (Complexity of rescheduled laws). With the as- 
sumptions of Definition 3.30, letT: \\ i& jX^ — > {true, false} be a coordi- 
nation task for S. Then, for all xq g Yliei Xq > 

TC(T,CC {s , Vl) ,xo) = s-TC(T,CC,x ). 

Moreover, if C rnd is additive, then, for all xq G Yii^i ^o > 

MCC(T,CC {StVl) ,x ) = ^-MCC(T,CC,x ), 

and therefore, TCC(TJCC( s -p J ),xo) = TCC(T, CC, xq), that is, the total com- 
munication complexity of CC is invariant under rescheduling. 

Remark 3.32 (Appropriate complexity notions for driftless agents). 

Given the results in the previous theorem, one should be careful in choosing 
which notion of communication complexity to use in order to evaluate control 
and communication laws. For driftless physical agents, rather than the 
mean communication complexity MCC, one should really consider the total 
communication complexity TCC, since the latter is invariant with respect to 
rescheduling. Note that the notion of infinite-horizon mean communication 
complexity IH-MCC defined in Remark 3.27 satisfies the same relationship 
as MCC, that is, IH-MCC (CC {SjVl) ,x ) = ± IH-MCC(CC,x ). • 



162 



"Distributed Control of Robotic Networks" by F. Bullo, J. Cortes and S. Martinez 
Copyright © 2006-2009. Manuscript under contract. This version: March 22, 2009 



DCRN March 22, 2009 



3.4 COMPLEXITY OF DIRECTION AGREEMENT AND 
EQUIDISTANCE 

From Example 3.7, Section 3.1.3, and Example 3.22, recall the definition of 
a uniform network 5 c ircle of locally connected first-order agents in S 1 , the 
AGREE & PURSUE control and communication law CC AGREE & pursue ; and the 
two coordination tasks T d ± T and T^.eqdstnc- I n this section, we characterize 
the complexity to achieve these coordination tasks with CC AGREE & pursue- 
Because the number of bits required to represent the variable max- id £ 
{1, . . . , n} is log(n), note that the space complexity of CC AGREE & pursue is 
log(n) bits, that is, one basic memory unit in our convention discussed in 
Section 3.3.2. 

Motivated by Remark 3.8, we model wireless communication congestion 
by assuming that the communication range is a monotone non-increasing 
function r : N — > ]0, tt[ of the number of agents n. Likewise, we assume that 
the maximum control amplitude u max is a non-increasing function u max : 
N — > ]0, 1[; recall that tt max is the maximum robot speed. Finally, it is 
convenient to define the function n i— > 5(n) = nr(n) — 2n £ R that compares 
the sum of the communication ranges of all the robots with the length of 
the unit circle. 

We are now ready to state the main result of this section; proofs are 
postponed to Section 3.6.2. 

Theorem 3.33 (Time complexity of agree-and-pursue law). Given 
fcprop £ ]0)o[> * n ^ e ^m«£ as n —i- +oo and e — > + , the network 5 c i rc i e 
with u max (n) > A; prop r(n), the law CC AGREE & pursue; and the tasks T d ± T and 
7e-eqdstnc together satisfy the following properties: 

(i) TC(T dir ,CC AGREE& pursue) e 9(r(n)- 1 ). 

(ii) If 5(n) is lower bounded by a positive constant as n — > +oo, then 

TC(7^_ eq d s t nc , CC AGRBE Sz pursue) £ il(n log(ne) ), 

TC(7;_e q dstnc,CC AGREE & p Ur sue) G 0(n 2 log(ne -1 )). 

If 5(n) is upper bounded by a negative constant, then in general the 
law CC AGREE & pursue does not achieve T £ _ eqdstnc . 

Next, we study the total communication complexity of the agree-and- 
pursue control and communication law. First, we note that any message in 
A = S 1 x {cc, c} x {1, . . . , n} Ujnull} requires only a finite number of basic 
messages to encode, that is, |A|basic £ 0(1). 

Theorem 3.34 (Total communication complexity of agree-and-pur- 
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sue law). For k prop £ ]0, g[> in the limit as n — > +00 and e — > + ; i/ie 
network S circ i e w#i u max (n) > fc pro pr(n), ifte law CC agree & pursue, and the 
tasks 7dir ond ^-eqdstnc together satisfy the following properties: 

(i) If 5{ri) > n(l/ kp Top — 2) as n — > +00, i/ten 

TCC(T dir ,CC AGREE & pursue) G ©(n 2 r(n) _1 ); 

otherwise, if 5(n) < ir(l/kp TO p — 2) as n —> +oo ; iften 

TCC(T dir ,CC AGREE & P ur S ue) G 0(n 3 + nr(n)" 1 ), 

TCC(T dir ,CC AGREE & pursue) G 0(n 2 r(n)" 1 ). 

(ii^j If 6(n) is lower bounded by a positive constant as n — > +00, i/ien 

TCC(T e _ eqdstn c,CC AGREE & pursue) G Q(n 3 <5(n) log(ne)" 1 ), 

TCC(7;_ e q ds t nc , CCagree & pursue) G 0(n 4 log(ne -1 )). 

Remark 3.35 (Comparison with leader election). Let us compare 
the agree- and-pur sue control and communication law with the classical Le 
Lann-Chang-Roberts (LCR) algorithm for leader election discussed 
in Section 1.5.4. The leader election task consists of electing a unique agent 
among all agents in the network; therefore, it is different from, but closely 
related to, the coordination task Tdir- The LCR algorithm operates on 
a static network with the ring communication topology, and achieves leader 
election with time and total communication complexity 0(n) and G(n 2 ), 
respectively. The agree-and-pursue law operates on a robotic network with 
the r(n)-disk communication topology, and achieves T iii: with time and to- 
tal communication complexity, respectively, 0(r(n) _1 ) and 0{n 2 r(n)~ 1 ). If 
wireless communication congestion is modeled by r{n) of order 1/n as in Re- 
mark 3.8, then the two algorithms have identical time complexity and the 
LCR ALGORITHM has better communication complexity. Note that com- 
putations on a possibly disconnected, dynamic network are more complex 
than on a static ring topology. • 

3.5 NOTES 

The study of multi-robot systems has a long and rich history. Some recent 
examples include the surveys (Asama, 1992; Cao et al., 1997; Dias et al., 
2006), the text by Arkin (1998) on behavior-based robotics, and the special 
issues (Arai et al., 2002; Abdallah and Tanner, 2007; Bullo et al., 2009). 
Together with this literature, the starting points for developing the material 
in this chapter are the standard notions of synchronous and asynchronous 
networks in distributed (Lynch, 1997; Peleg, 2000; Tel, 2001) and paral- 
lel (Bertsekas and Tsitsiklis, 1997; Parhami, 1999) computation. The estab- 
lished body of knowledge on synchronous networks is, however, not directly 
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applicable to the robotic network setting because of the agents' mobility and 
the ensuing dynamic communication topology. 

An influential contribution toward a network model of mobile interacting 
robots is the work by Suzuki and Yamashita (1999). This model consists of 
a group of identical "distributed anonymous mobile robots" characterized as 
follows: no explicit communication takes place between them, and at each 
time instant of an "activation schedule," each robot senses the relative posi- 
tion of all other robots and moves according to a pre-specified algorithm. An 
artificial intelligence approach to multi-agent behavior in a shared environ- 
ment is taken in Moses and Tennenholtz (1995). Santoro (2001) provides, 
with an emphasis on computer science aspects, a brief survey of models, algo- 
rithms, and the need for appropriate complexity notions. Recently, a notion 
of communication complexity for control and communication algorithms in 
multi-robot systems has been analyzed by Klavins (2003); see also Klavins 
and Murray (2004). Notions of failures and robustness in robotic networks 
are discussed by Gupta et al. (2006b). Prom a broad hybrid networked sys- 
tems viewpoint, our robotic network model can be regarded as special cases 
of the general modeling paradigms discussed in Lygeros et al. (2003), Lynch 
et al. (2003), and Sanfelice et al. (2007). 

A key feature of the synchronous robotic network model proposed in this 
chapter is the adoption of proximity graphs from computational geometry 
as a basis for our communication model. This design choice is justified by 
the vast wireless networking literature, where this assumption is made. The 
simplest communication model, in which two robots communicate only if 
they are within a fixed communication range, is a common model adopted, 
for example, in the studies by Gupta and Kumar (2000), Li (2003), Lloyd 
et al. (2005), and Santi (2005). These works study the proximity graph 
solutions to various communication optimization problems; this discipline 
is referred to as topology control (cf., Remark 3.8). Although we focus our 
presentation on the topological aspect of the communication service, more 
realistic communication models would include randomness, packet losses, 
coding, quantization, and delays (see, e.g., Toh, 2001; Tse and Viswanath, 
2005). 

Next, we review some literature on emergent and self-organized swarm- 
ing behaviors in biological groups. Interesting dynamical systems arise in 
biological networks at multiple levels of resolution, all the way from interac- 
tions among molecules and cells (Miller and Bassler, 2001) to the behavioral 
ecology of animal groups (Okubo, 1986). Flocks of birds and schools of 
fish can travel in formation and act as one (see Parrish et al., 2002), al- 
lowing these animals to defend themselves against predators and protect 
their territories. Wildebeest and other animals exhibit complex collective 
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behaviors when migrating, such as obstacle avoidance, leader election, and 
formation-keeping (see Sinclair, 1977; Gueron and Levin, 1993). Certain for- 
aging behaviors include individual animals partitioning their environment 
into non-overlapping zones (see Barlow, 1974). Honey bees (Seeley and 
Buhrman, 1999), gorillas (Stewart and Harcourt, 1994), and whitefaced ca- 
puchins (Boinski and Campbell, 1995) exhibit synchronized group activities 
such as initiation of motion and change of travel direction. These remark- 
able dynamic capabilities are achieved apparently without following a group 
leader; see Barlow (1974), Okubo (1986), Gueron and Levin (1993), Stewart 
and Harcourt (1994), Seeley and Buhrman (1999), Boinski and Campbell 
(1995), and Parrish et al. (2002) for specific examples of animal species, 
and Conradt and Roper (2003), and Couzin et al. (2005) for general stud- 
ies. A comprehensive exposition of bio-inspired optimization and control 
methods is presented in Passino (2004). 

Regarding distributed motion coordination algorithms, much progress has 
been made on collective pattern formation (Suzuki and Yamashita, 1999; 
Belta and Kumar, 2004; Justh and Krishnaprasad, 2004; Sepulchre et al., 
2007; Paley et al., 2007; Yang et al., 2008), flocking (Olfati-Saber, 2006; Lee 
and Spong, 2007; Tanner et al., 2007; Moshtagh and Jadbabaie, 2007), mo- 
tion feasibility of formations (Tabuada et al., 2005), formation control using 
rigidity and persistence theory (Olfati-Saber and Murray, 2002; Baillieul 
and Suri, 2003; Hendrickx et al., 2007; Krick, 2007; Yu et al., 2009), forma- 
tion stability (Tanner et al., 2004; Lafferriere et al., 2005; Kang et al., 2006; 
Dunbar and Murray, 2006; Smith and Hadaegh, 2007; Zheng et al., 2008), 
motion camouflage (Justh and Krishnaprasad, 2006), self-assembly (Klavins 
et al., 2006), swarm aggregation (Gazi and Passino, 2003), gradient climb- 
ing (Ogren et al., 2004; Cortes, 2007), cyclic-pursuit (Bruckstein et al., 1991; 
Marshall et al., 2004; Martinez and Bullo, 2006; Smith et al., 2005; Pavone 
and Frazzoli, 2007), vehicle routing (Sharma et al., 2007), motion plan- 
ning with collision avoidance (Lumelsky and Harinarayan, 1997; Hu et al., 
2007; Pallottino et al., 2007), and cooperative boundary estimation (Bertozzi 
et al., 2004; Zhang and Leonard, 2005; Clark and Fierro, 2007; Casbeer et al., 
2006; Susca et al., 2008). It is also worth mentioning works on network lo- 
calization, estimation, and tracking (see, e.g., Aspnes et al., 2006; Barooah 
and Hespanha, 2007; Oh et al., 2007; and the references therein). 

Much research has been devoted to distributed task allocation problems. 
The work in (Gerkey and Mataric, 2004) proposes a taxonomy of task alloca- 
tion problems. In papers such as (Godwin et al., 2006; Alighanbari and How, 
2006; Schumacher et al., 2003; Moore and Passino, 2007; Tang and Ozgiiner, 
2005), advanced heuristic methods are developed, and their effectiveness is 
demonstrated through analysis, simulation or real world implementation. 
Distributed auction algorithms are discussed in (Castahon and Wu, 2003; 
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Moore and Passino, 2007) building on the classic works in (Bertsekas and 
Castahon, 1991, 1993). A distributed mixed-integer-linear-programming 
solver is proposed in (Alighanbari and How, 2006). A spatially distributed 
receding-horizon scheme is proposed in (Frazzoli and Bullo, 2004; Pavone 
et al., 2007). There has also been prior work on target assignment prob- 
lems (Beard et al., 2002; Arslan et al., 2007; Zavlanos and Pappas, 2007a; 
Smith and Bullo, 2009). Target allocation for vehicles with nonholonomic 
constraints is studied in (Rathinam et al., 2007; Savla et al., 2008, 2009a). 

3.6 PROOFS 

This section gathers the proofs of the main results presented in the chapter. 



3.6.1 Proof of Proposition 3.31 

Proof. Let t i— > x{t) and t \— > x(t) denote the network evolutions starting 

from xq £ Iliei -^o un der CC and CC^-p^, respectively. From the definition 
of rescheduling, one can verify that, for all k £ Z>o, 

~ [%) = i^(F(k - 1) + 1), for t £ \J%$£. 1)+1 [l,l + l], (3 6 1} 
\x^{t-F(k) + k), fort£ [F(k),F(k) + l]. 

By the definition of time complexity TC(Tj CC, Xo), we have T(x(k)) = true, 
for all k > TC{T,CC,x ), and T(x(TC(T,CC,x ) - 1)) = false. We rewrite 
these equalities in terms of the trajectories of CCu-p^. From (3.6.1), we 
write x^ik) = x^'(F(k)), for all i £ / and k £ Z>o- Therefore, we have 

T{i{F{k))) = T{x{k)) = true, for all F{k) > F{TC(T,CC,x )), 

T{S:(F{TC{T,CC,xo) - 1))) = T(x{TC(T,CC,x ) - 1)) = false, 

where we have used the rescheduled message- generation function in (3.3.2). 
Now, note that by equation (3.6.1), x®(£) = x^(F([£/s\ - 1) + 1), for 
all I £ Z> and all i £ /. Therefore, T(x(F(TC(T,CC, x ) - 1) + 1)) = 
T(x(F(TC(T,CC,xq)))) and we can rewrite the previous identities as 

T(x{k)) = true, for all k > F(TC(T,CC,x ) - 1) + 1, 
T{x{F(TC(T,CC,x ) - 1))) = false, 

which implies TC(T, CC {S)Vl) ,x ) = F(TC(T, CC, x Q )-l)+l = s TC{T, CC,x ). 
As for the mean communication complexity, additivity of C rnd implies 

C ind oM(l,x(£)) 
= C vnd oM(F(£) - s + l,x(F(£) - s + 1)) + ■ ■ ■ + C rnd oM(F(£),x(F(£))), 
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where we have used F{£ — 1) + 1 = F(£) — s + 1. We conclude the proof by 
computing 

TC(T,CC (S-Pj) ,x )-1 F{TC(T,CC,x a )-l) 

E C rnd oM(£,x(£))= E C rnd oM(^W) 

£=0 £=0 

TC(T,CC,x )-l F(£) 

E E C rnd oX(A:,x(fc)) 

£=0 fc=F(£)-s+l 

TC(T,CC>o)-l 

E C md oM(^(|)). 

£=0 



3.6.2 Proof of Theorem 3.33 

Proof. In the following four STEPS, we prove the two upper bounds and 
the two lower bounds. 

STEP 1: We start by proving the upper bound in statement (i). We claim 
that TC(7^ ir , CC AGREE & PURSU b) < 2-7r/(k prop r(n)), and we reason by contra- 
diction, that is, we assume that there exists an initial condition which gives 
rise to an execution with time complexity strictly larger than 27r/(fc pr0 pr(n)). 
Without loss of generality, assume dir[ n l(0) = c. For £ < 27r/(fc prop r(n)), 
define 

k(£) =argmin{dist cc (0M(O),<9 [ %)) | dir%) = cc, i G {l,...,n}}. 

In other words, agent k(£) is the agent moving counterclockwise that has 
smallest counterclockwise distance from the initial position of agent n. Note 
that k(£) is well-defined since, by hypothesis of contradiction, T diT is false 
for £ < 2n/(k pv0 pr(n)). According to the state-transition function of the 
law CC AGREE & pursue (cf., Section 3.1.3), messages with dir = cc can only 
travel counterclockwise, while messages with dir = c can only travel clock- 
wise. Therefore, the position of agent k{£) at time £ can only belong to the 
counterclockwise interval from the position of agent fc(0) at time to the 
position of agent n at time 0. 

Let us examine how fast the message from agent n travels clockwise. To 
this end, for £ < 2ir/(kp rop r(n)), define 

j(£) = argmax{dist c (0 W (O),<9 [ %)) | max-id%) = n, i G {1,.. . ,n}}. 
In other words, agent j(£) has max-id equal to n, is moving clockwise, and 
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is the agent furthest from the initial position of agent n in the clockwise 
direction with these two properties. Initially, j(0) = n. Additionally, for 
£ < 2n/(k prop r(n)), we claim that 

dist c (0^%),0^+i%+ i)) > k pvop r(n). 

This happens because either (1) there is no agent clockwise-ahead of 0^ ''(£) 
within clockwise distance r(n), and therefore, the claim is obvious, or (2) 
there are such agents. In case (2), let m denote the agent whose clockwise 
distance to agent j{l) is maximal within the set of agents with clockwise 
distance r(n) from 9^^ >>(£). Then, 

dist c (6<^%),^ +1 %+l)) 

= dist c {9 [jW] {£),9^{£+l)) 

= dist c (9^(£),0W(£)) + dist c (0H(£) ) 0M(£+ l)) 

> dist c (9^(£),6W(£)) + k pTop (r(n) - dist c (9^\£),9^(£))) 

= k prop r(n) + (1 - fc pro p) dist c (flb-W](£), 9^(£)) > k pvop r(n), 

where the first inequality follows from the fact that at time £ there can 
be no agent whose clockwise distance to agent m is less than (r(n) — 
dist c (^^( "{£), 9^ m '(£))). Therefore, after a number of communication rounds 
larger than 27r/(fc prop r(n)), the message with max-id = n has traveled the 
whole circle in the clockwise direction, and must therefore have reached 
agent k(£). This is a contradiction. 

STEP 2: We prove the lower bound in statement (i). If r(n) > it for all 
n, then l/r(n) < l/V, and the upper bound is TC(7^ lr , CC AGREE & pursue) £ 
0(1). Obviously, the time complexity of any evolution with an initial con- 
figuration where dir^(O) = cc for i £ {l,...,n — 1}, dir' n '(0) = c, and 
£g diBk (r)(0 (0)> ■ ■ • 5$ (0)) is t ne complete graph, is lower bounded by 1. 
Therefore, TC(7^ ir , CC agree & pursue) G ^(1)- If r(n) > ir for all n, then 
we conclude TC(7^ ir , CC AGREE & pursue) £ 0(r(n) _1 ). Assume now that 
r(n) < n for sufficiently large n. Consider an initial configuration where 
dirW(O) = cc for i £ {l,...,n — 1}, dirl n l(0) = c, and the agents are 
placed as depicted in Figure 3.10. Note that, after each communication 
round, agent 1 has moved k pTop r(n) in the counterclockwise direction, while 
agent n has moved fc prop r(n) in the clockwise direction. These two agents 
keep moving at full speed toward each other until they become neighbors at 
a time lower bounded by 

2tt — r(n) tt 

—^ > 1. 

2k pTop r(n) k pvop r[n) 

We conclude that TC(7~ dir , CC AGREE & PURSUE ) G f2(r(n) _1 ). 
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Figure 3.10 Initial condition for the lower bound of TC(7^ ir , CC agree & pursue), with < 
dist c (6> |n - 1] (0),(J [nl (0)) - r{n) < e and dist c ((9 [1] (0), 6» [ "~ 1] (0)) < r(n) - e, for 
some fixed e > 0. 



STEP 3: We now prove the upper bound in (ii). We begin by noting 
that the lower bound on 5 implies r(n)~ 1 £ 0(n). Therefore, we know that 
TC(7^ ir , CC agree & pursue) belongs to 0{n) and is negligible as compared 
with the claimed upper bound estimates for TC(7^_ e qd s tnc)CC AGREE & pursue)- 
In what follows, we therefore assume that T Ai _ T has been achieved and that, 
without loss of generality, all agents are moving clockwise. We now prove a 
fact regarding connectivity. At time £ £ Z>o, let H{£) be the union of all 
the empty "circular segments" of length at least r(n), that is, let 

H{£) = {x£§ 1 \ min dist c (x,0 [ %)) + min dist cc (x, 6 [j] {£)) > r{n)}. 

ie{l,...,n} j£{l,...,n} 

In other words, H(£) does not contain any point between two agents sepa- 
rated by a distance less than r(n), and each connected component of H{£) 
has length at least r{n). Let nn{£) be the number of connected components 
of H(£); if H(£) is empty, then we take the convention that nu{£) — 0. 
Clearly, nn{£) < n. We claim that if nn{£) > 0, then r i— > ri}{(£ + r) is non- 
increasing. Let d{£) < r{n) be the distance between any two consecutive 
agents at time £. Because both agents move in the same direction, a simple 
calculation shows that 

d(£ + 1) < d{£) + k pmp (r - d{£)) = (1 - k pTop )d(£) + A: prop r(n) 
< (1 - k pmp )r + k prop r(n) = r(n). 

This means that the two agents remain within distance r(n) and, therefore, 
connected at the following time instant. Because the number of connected 
components of £g dlBk ( r ){@ > • • • > $ ) does not increase, it follows that the 
number of connected components of H cannot increase. Next, we claim 
that if uh(£) > 0, then there exists r > £ such that uh{t) < uh{£)- By 
contradiction, assume that riH(£) = n#(Y) for all r > £. Without loss 
of generality, let {l,...,m} be a set of agents with the properties that 
dist cc (9^(£),0^ i+1 H£)) < r(n), for i G {l,...,m}, that 6>M(f) and 6^ m \£) 
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belong to the boundary of H{t), and that there is no other set with the 
same properties and more agents. (Note that this implies that the agents 
1, . . . , m are in counterclockwise order.) One can show that, for r > £, 

#W( T + 1) = 0W( T )-A: prop r(n), 

0W( r + l) = 0M( r ) - ^dist^^T),^^)), 

for i £ {2, . . . , m}. If we consider the inter-agent distances 

d{r) = (dist cc (^ 1 ](r),0[ 2 ](r)),...,dist cc (^ m - 1 ](T)^H (r) )) e R™~\ 

then the previous equations can be rewritten as 

d(r + 1) = Trid m _i(fc prop , 1 - A; prop ,0) d(r) + r(n)/e prop ei, 

where the linear map (a,b,c) i— > Trid m _i(a, b, c) £ R( m-1 ) x ( m-1 ) is defined 
in Section 1.6.4. This is a discrete-time affine time-invariant dynamical 
system with unique equilibrium point r(ri) l m _i. By construction, the initial 
condition of this system satisfies ||d(0) — r(n)l m _i||2 < r(n)y/m — 1. By 
Theorem 1.79(H) in Section 1.6.4, for rji £ ]0, 1[, the solution r i— > d(r) to this 
system reaches a ball of radius 771 centered at the equilibrium point in time 
0(m log 7Ti + log 77 j~ ). (Here we have used the fact that the initial condition 
of this system is bounded.) In turn, this implies that r 1— ► ^12=1 ^( T ) is 
larger than (m — l)(r(n) — r]\) in time 0(m log m + log??j~ ). We are now 
ready to find the contradiction, and show that ri//(r) cannot remain equal to 
n//(£) for all time r. After time 0(m log m + log r]± ) = 0(n log n + log 77^ ), 
we have 

2-7T > ni{(i)r(n) + >^ (r(n) — r]i)(mj — 1) 

i=i 
= n H (£)r(n) + (n - n H (£))(r(n) - r/i) = n# (^)r/i + n(r(n) - r/i). 



Here, mi, . . . , m nH m are the numbers of agents in each isolated group, and 
each connected component of H{i) has length at least r(n). Now, take 
771 = (nr(n) — 2ir)n~ 1 = (5(n)n _1 , and the contradiction follows from 

27r > nu(£)r]i + nr(n) — nr)\ 

— n H(^)Vi + nr(n) + 27r — nr(n) = n#(^)7/i + 27r. 

In summary, this shows that the number of connected components of i^(^) 
decreases by one in time 0(nlogn + log 77^ ) = 0(nlogn + log(ra<5(n) -1 )). 
Note that 5 being lower bounded implies that nSfa) -1 = 0(n) and, there- 
fore, 0(n log n + log(n<5(n) -1 )) = 0(n log n). Iterating this argument n 
times, in time 0(n 2 log n) the set H will become empty. At that time, the 
resulting network will obey the discrete-time linear time-invariant dynamical 
system 

d(r + 1) = Circ n (fc prop , 1 - fc prop , 0) d(r), (3.6.2) 
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where the linear map (a,b,c) i— > Circ n (a,6, c) G R nxn is defined in Sec- 
tion 1.6.4 and where d : Z>o — > M> * s defined by 

d(T) = (dist cc (eW(T),^ 2 ](T)) ) ...,dist cc (eN( T ),^+ 1 l( r ))), 

with the convention $i n+1 ' = 0W. By Theorem 1.79(iii) in Section 1.6.4, 
in time 0(n 2 log e _1 ), the error 2-norm satisfies the contraction inequality 

\\d(r) — d*|| 2 < £ 11^(0) ~~ ^*||2) for d* = ^ln- We convert this inequality on 
2-norms into an appropriate inequality on co-norms as follows. Note that 
||d(0) - d*||oo = max ie{lv n} |rfW(0) - df\ < 2ir. For r/ 2 G ]0, 1[ and for r of 
order n 2 log r/^ , 

\\d(r) - ^||oo < ||d(r) - d*|| 2 < »^||d(0) - d*|| 2 



This means that the desired configuration is achieved for r)22it\/n = e, that 
is, in time 0(n 2 log rf^ ) = 0(n 2 log(ne -1 )). In summary, the equidistance 
task is achieved in time 0(n 2 log(ne -1 )). 

STEP 4-' Finally, we prove the lower bound in (ii). As we reasoned 
before, TC(7^ ir , CC AGREE & pursue) is negligible as compared with the claimed 
lower bound estimate for TC(T £ _ eq d stnc , CC agree & pursue) and, therefore, we 
assume that T d ± r has been achieved. We consider an initial configuration 
with the properties that: (i) agents are counterclockwise-ordered according 
to their unique identifier; (ii) the set H(0) is empty; and (iii) the inter-agent 
distances d(0) = (dist cc (0W(O),0[ 2 ](O)), . . . ,dist ec (0 W (O),0M(O))) are 

,. . 2n tv — e' 

d(0) = — 1„ + v n + v n ), 

n n 

where e' G ]ir, 0[ and where v n is the eigenvector of Circ n (fc prop , 1 — k prop , 0) 

corresponding to the eigenvalue 1 — k piop + k piop cos (^f) — ^propv 7 — 1 sin ( 2 ^ L ) 

(see Section 1.6.4). Straightforward calculations show the equality v n +v n = 

2(1, cos(27r/n), ... ,cos((n — l)2ir/n)) and that ||v n + v n |J2 = v2n. In turn, 

this implies that d(0) G M> and that ||d(0) - ^lnh G 0{l/y/n). Take 

r/3 G ]0, 1[. The argument described in the proof of Theorem 1.79(iii) leads 

to the following statement: the 2-norm of the difference between t \— > d(£) 

and the desired configuration ^l n decreases by a factor 773 in time of order 

n 2 log 773" . Given an initial error of order 0(l/y/n) and a final desired error 



of order e, we set 773 = e\/n and obtain the desired result that it takes time 
of order n 2 log(ne) -1 to reduce the 2-norm error and, therefore, the oo-norm 
error to size e. This concludes the proof. ■ 
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3.6.3 Proof of Theorem 3.34 

Proof. Note that the number of edges in 5 C i rc i e is at most 0(n 2 ), as it is 
possible that all robots are within distance r(n) of each other. The upper 
bounds in (i) and (ii) then follow from inequality (3.3.1) and Theorem 3.33. 
To prove the lower bounds, we follow the steps and notation in the proof 
of Theorem 3.33. Regarding the lower bounds in (i), we examine the evolu- 
tion of the initial configuration depicted in Figure 3.10. From STEP 2: in 
the proof of Theorem 3.33, recall that the time it takes agent 1 to receive 
the message with max-id = n is lower bounded by 7r/(fc prop r(n)) — 1. Our 
proof strategy is to lower bound the number of edges in the graph until this 
event happens. Note that, at initial time, there are (n — l) 2 edges in the 
communication graph of the network and, therefore, (n — l) 2 messages get 
transmitted. At the next communication round, agent 1 has moved fc pr op?"( n ) 
counterclockwise and, therefore, the number of edges is lower bounded by 
(n — 2) 2 . Iterating this reasoning, we see that after i < n/(k pTop r(n)) com- 
munication rounds, the number of edges is lower bounded by (n — i) 2 . Now, 
if 5(n) > Tr(l/k pTop — 2), then n > 7r/fc prop r(n)), and therefore, the total 
communication complexity is lower bounded by 



,r(») 



Y^ {n-if G Q(n 2 r(n)- X ). 
i=\ 

On the other hand, if 5(n) < Tr(l/k prop — 2), then n < 7r/fc prop r(n)), and after 
n time steps, we lower bound the number of edges in the communication 
graph by the number of edges in a chain of length n, that is, n—1. Therefore, 
the total communication complexity is lower bounded by 

n 

VVn - i) 2 + (n - 1) (- — ^— - - n) € ft(n 3 + nr(n)~ l ). 
The two lower bounds match when 5(n) = 7r(l/fc prop — 2). 



Regarding the lower bound in (ii), we consider first the case when n#(0) = 
0. In this case, the network obeys the discrete-time linear time-invariant dy- 
namical system (3.6.2). Consider the initial condition d(0) that we adopted 
for STEP 4 : - We know it takes time of order n 2 log(ne) _1 for the appro- 
priate contraction property to hold. At d(0), the maximal inter-agent dis- 
tance is (47r — e')/n and it decreases during the evolution. Because each 
robot can communicate with any other robot within a distance r(n), the 
number of agents within communication range of a given agent is of order 
r(n)n/(4-7r — e'), that is, of order 5(n). From here, we deduce that the total 
communication complexity belongs to Q,(n 3 5(n) log(ne) -1 ). ■ 
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3.7 EXERCISES 

E3.1 (Orientation dynamics). We review some basic kinematic concepts about ori- 
entation dynamics, (see, e.g., Bullo and Lewis, 2004; Spong et al., 2006. Define 
the set of skew-symmetric matrices in R dxd as 

so(d) = {S &R dxd | S = -S T }. 

Let x denote the cross-product on R 3 and define the linear map~: R 3 — > so (3) by 
xy — x x y for all y £ R 3 . 

(i) Show that, if x — (0:1,0:2,3:3), then: 






-x 3 


X 2 


x 3 





-Xl 


-X 2 


Xl 






(ii) Given a differentiable curve R : [0,T] — > SO(3), show that there exists a 
curve w : [0, T] -> R 3 such that 

R{t) = R{t)D(t). 

These two results lead to a motion model of a relative sensing network with 
time-varying orientation. Generalizing the constant-orientation model in equa- 
tion (3.2.2), the complete position and orientation dynamics may be written as 

pLd(*) = -RLd (*)«!*'. 
flLd(*) = -RLd(*)2i fl , 

where, for i £ {1, . . . , n}, Uj and lj\ are the linear and the body angular velocities 
of robot i, respectively. 

E3.2 (Variation of the agree & pursue control and communication law). Con- 
sider the AGREE & PURSUE control and communication law defined in Section 3.1.3, 
with the state transition function replaced by the following: 

function stf(#, w, y) 
1: for each non-null message (# rcv d, (dir rcv d,max-id rcv d)) in y do 
2: if (max-id rcv d > max-id) then 
3: new-dir := dir rcv d 

4: new-id := max-id rcv d 

5: return (new-dir, new-id) 

The only difference between this law and the AGREE & PURSUE law in Sec- 
tion 3.1.3 is that, in each communication round, each agent picks the message 
with the largest value of max-id among all messages received (instead of among 
the messages received only from agents moving towards its position). We refer to 
this law as mod-agree & pursue. 

Consider the direction agreement task 7di r : (S 1 )" x W n — > {true, false} 
defined in Example 3.22. Assume that dir' n '(0) = c, and let k £ {1, . . . ,n — 1} 
be the largest identity such that dir' fe '(0) = cc. Do the following tasks: 

(i) Show that if the message from agent k gets delivered to agents clockwise- 
placed with respect to agent k along two consecutive communication 
rounds, then the message from agent k has traveled at least (1 — fc prop )r(n) 
along the circle in the clockwise direction. 
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(ii) Show that, if dist cc (6» |n] (0), 6» w (0)) < 2r(n), then 

TG(T dil ,CC mod-agree & puhsuejKo, Wo) = @{r(n)~ ). 

(hi) Implement the algorithm in your favorite simulation software (for ex- 
ample, Mathematica© Matlab© or Maple©), and compute the time 
complexity of multiple executions of the algorithm starting from different 
initial conditions. Does your simulation analysis support the conjecture 
that 

TC(T diT ,CC MOD-AGREE & PURSUE ) = Q(r(ri)~ )? 

For the simulation analysis to be relevant, you should use a large number 
of randomly generated initial physical positions and processor states. 

E3.3 (Leader-following flocking). Consider a group of robots moving in R 2 accord- 
ing to the following discrete-time version of the planar vehicle dynamics introduced 
in Example 3.1: 



x(£+l)~- 


= x(£) + v cos{6{£)) 


y{i+l) = 


= y(l) + vsin(e(£)), 


9(1+1)-- 


= e(£)+u. 



We let {(p [1] ,0 [1] ), . . . , (p [n] ,6> [n| )} denote the robot physical states, where p w = 
(a: , j/' 1 ') £ R 2 corresponds to the position and O'-'' € [0, 2n) corresponds to the 
orientation of the robot i 6 J. As communication graph, we adopt the r-disk 
graph SdiskM introduced in Section 2.2. 

Assume that all agents move at unit speed, v — 1, and update their heading 
according to the leader-following version of Vicsek's model (see equation (1.6.5)): 

e [1] {i + i) = e [1] {£), (E3.i) 

6 l ' ] {£ + 1) = a,vrg({6 l ' ] {l)}u{6 b] {£) \ j s.t. \\p b] {£) - p l ' l] {£)\\ 2 < r}\ 

for i G {2, . . . , n}. Do the following tasks: 

(i) Write the algorithm formally as a control and communication law as 
defined in Section 3.1.2. 

(ii) Given initial conditions for the position and orientation of the robots, 
express (E3.1) as the time-dependent linear iteration associated to a se- 
quence of matrices {F(£) | £ € Z> }. Are these matrices stochastic? Are 
they symmetric? Is the sequence non-degenerate? 

(iii) We loosely define the flocking task as achieving agreement on the heading 
of the agents. Using Theorem 1.63, identify connectivity conditions on 
the sequence of graphs determined by the evolution of the network that 
guarantee that agents achieve flocking. What is the final orientation in 
which the network flocks? 
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Chapter Four 

Connectivity maintenance and rendezvous 



The aims of this chapter are twofold. First, we introduce the rendezvous 
problem and analyze various coordination algorithms that achieve it, provid- 
ing upper and lower bounds on their time complexity. Second, we introduce 
the problem of maintaining connectivity among a group of mobile robots 
and use geometric approaches to preserve this topological property of the 
network. 

Loosely speaking, the rendezvous objective is to achieve agreement over the 
physical location of as many robots as possible, that is, to steer the robots 
to a common location. This objective is to be achieved with the limited 
information flow described in the model of the network. Typically, it will 
be impossible to solve the rendezvous problem for all robots if the robots 
are placed in such a way that they do not form a connected communication 
graph. Therefore, it is reasonable to assume that the network is connected at 
initial time, and that a good property of any rendezvous algorithm is that 
of maintaining some form of connectivity among robots. This discussion 
motivates the connectivity maintenance problem. Once a model for when two 
robots can acquire each other's relative position is adopted, this problem is 
of particular relevance, as the inter-robot topology depends on the physical 
states of the robots. Our exposition here is mainly based on Ando et al. 
(1999), Cortes et al. (2006), and Ganguli et al. (2009). 

The chapter is organized as follows. In the first section, we formally 
introduce the two coordination problems. In the second section, we de- 
fine various connectivity constraint sets to limit the motion of robots in 
order to maintain network connectivity. These notions of constraint sets 
allows us to study in the next section various rendezvous algorithms with 
connectivity maintenance properties. We study numerous variations of the 
circumcenter algorithm for the rendezvous objective and we characterize its 
complexity. Additionally, we introduce the perimeter-minimizing algorithm 
for nonconvex environments. The fourth section presents various simula- 
tions of the proposed motion-coordination algorithms. We end the chapter 
with three sections on, respectively, bibliographic notes, proofs of the results 
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presented in the chapter, and exercises. Our technical treatment is based 
on the LaSalle Invariance Principle, on linear distributed algorithms, and 
on geometric tools such as proximity graphs and robust visibility. 

4.1 PROBLEM STATEMENT 

We begin this section by reviewing the classes of networks and the types of 
problems that will be considered in the chapter. 



4.1.1 Networks with discrete-time motion 

In the course of the chapter, we will consider the robotic networks 5disk, <^ld, 
and 5oo-disk> and the relative-sensing networks 5^isk anc ^ '-'vis-disk presented 
in Example 3.4 and in Section 3.2.2. 

For the robotic networks 5diski 5ld 5 an ^ ^oo-disk) we will, however, assume 
that the robots move in discrete time, that is, we adopt the discrete-time 
motion model 

p^(£ + l)=p^(£) + u [i] (£), ie{l,...,n}. (4.1.1) 

Similarly, for the relative-sensing networks S^ lsk and 5^ sdisk , we adopt the 
discrete-time motion model 

pLiC + 1) = pLdW + 41d^ ] (*), < e {1, . . . , »}. (4.1.2) 

As an aside, if we express the previous equation with respect to frame i at 
time t, then equation (4.1.2) reads 

pfj ■ ... Jl + l) = uf t . ... J£), ie{l,...,n}. 

r (frame i at time £) v ' (frame i at time t) v ■" L ' ' J 

We present the treatment in discrete time for simplicity. It is easy to show 
that any control law for the discrete-time motion model can be implemented 
in the continuous-time networks. In what follows, we begin our discussion 
by assuming no bound on the control magnitude and we later introduce an 
upper bound denoted by u max - 



4.1.2 The rendezvous task 

Next, we discuss the rendezvous problem. There are different ways of formu- 
lating this objective in terms of task maps. Let S = ({1, . . . , n},TZ, E cmm ) 
be a uniform robotic network. The (exact) rendezvous task "Trndzvs : X n — > 
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{true, false} for S is the coordination task defined by 

-'rndzvsl^ j • • 

if X M = X W, for all (i,j) G E cmm (x^\ . . . , &M), 
otherwise. 

Next, assume that, for the same network S = ({1, . . . ,n},7Z, E cmm ), the 
robots' physical state space is I C I . It is convenient to review some 
basic notation consistent with what we adopted in Chapter 2. We let V = 
{p'- 1 ', . . . ,p*- n '} denote the set of agents' location in X C R and we let P be 
an array of n points in R . Furthermore, we let avrg denote the average of 
a finite point set in R , that is, 

avrg({<?i, . . . , q k }) = -(gH h q k )- 

For e g R>o> the e-rendezvous task T £ _ in ^ zvs : (R d ) n — > {true, false} for S 
is defined as follows: T £ _ rn( ^ zvs is true at P if and only if each robot position 
pW, for i G {1, . . . , n}, is at distance less than e from the average position of 
its -Ecmm-neighbors. Formally, 

^-rndzvs(-P) = true 

^^ ||pW - avrg ({p^ | (», j) G E cmm (P)})\\ 2 < e, i G {1, . . . ,n}. 



4.1.3 The connectivity maintenance problem 

Assume that the communication graph, computed as a function of the robot 
positions, is connected: How should the robots move in such a way that their 
communication graph is again connected? Clearly, the problem depends 
upon: (1) how the robots move; and (2) what proximity graph describes 
the communication graph or, in the case of relative-sensing networks, what 
sensor model is available on each robot. 

The key idea is to restrict the allowable motion of each agent. Different 
motion constraint sets correspond to different communication or sensing 
graphs. We have three objectives in doing so. First, we aim to achieve this 
objective only based on local measurements or 1-hop communication, that 
is, without introducing processor states explicitly dedicated to this task. 
Second, the constraint sets should depend continuously on the position of 
the robots. Third, we have the somehow informal objective to design the 
constraint sets as "large" as possible so as to minimally constrain the motion 
of the robots. 
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4.2 CONNECTIVITY MAINTENANCE ALGORITHMS 

In this section, we present some algorithms that might be used by a robotic 
network to maintain communication connectivity. The results presented in 
this section start with the original idea introduced by Ando et al. (1999) for 
first-order robots communicating along the edges of a disk graph, that is, 
for the network described in Example 3.4. This idea is then generalized to 
a number of useful settings. The properties of proximity graphs presented 
in Section 2.2 play a key role in formulating and solving the connectivity 
problem. 



4.2.1 Enforcing range-limited links 

First, we aim to constrain the motion of two first-order agents in order to 
maintain a communication link between them. We assume that the commu- 
nication takes place over the disk graph (? disk (r) with communication range 
r > 0. 

Loosely stated, the pairwise connectivity maintenance problem is as fol- 
lows: given two neighbors in the proximity graph <?disk( r )> find a rich set of 
control inputs for both agents with the property that, after moving, both 
agents are again within distance r. We provide a solution to this problem 
as follows. 

Definition 4.1 (Pairwise connectivity constraint set). Consider two 
agents i and j at positions p^' £ M. d and pu> £ R^ such that \\p^' —p^'\\2 < T. 
The connectivity constraint set of agent i with respect to agent j is 

Note that both robots, i and j, can independently compute their respec- 
tive connectivity constraint sets. The proof of the following result is straight- 
forward. 

Lemma 4.2 (Maintaining pairwise connectivity). Assume that the 
distance between agents p*- l > and p^' is no more than r, at some time i. If 
the control u^> (£) takes value in 

«"M e ^^(0,^(0) - P w«) - B (!Ma,:), 

and, similarly, vP\l) £ ^disk(p if)iP CO) ~~ P C0> then, according to the 
discrete-time motion model (4.1.1): 
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(i) the positions of both agents at time £ + 1 are inside the connectivity 
constraint set Xdisk(p {£) , P (£)) ; and 

(ii) the distance between the agents ' positions at time £ + 1 is no more 
than r. 

We illustrate these pairwise connectivity maintenance concepts in Fig- 
ure 4.1. 



yn fixed 

*- 




Figure 4.1 An illustration of the connectivity maintenance constraint. Starting from po- 
sitions p<-'> and p' J ' , the robots are restricted to moving inside the disk centered 
at Af dlsk (pW,pW) = \(p [i] +p [jl ) with radius §. 



Remark 4.3 (Constraints for relative-sensing networks). Let us con- 
sider a relative-sensing network with a disk sensor of radius r (see Exam- 
ple 3.15). Recall the following facts about this model. First, agent i mea- 
sures the position of robot j in its frame S^, that is, robot i measures 
Pi . Second, p\ = 0^. Third, if W C M. , then Wi denotes its expression 
in the frame S^. Combining these notions and assuming that the inter- 
agent distance is no more than r, the pairwise connectivity constraint set in 
Definition 4.1 satisfies 



X disk (P [M ,P m ) . = *disk(0rf J ) = B 



2 



4.2.2 Enforcing network connectivity 

Here, we focus on how to constrain the mobility of multiple agents in order 
to maintain connectivity for the entire network that they form. We again 
consider the case of first-order agents moving according to the discrete-time 
equation (4.1.1) and communicating over £disk( r )- 
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Loosely stated, the network connectivity maintenance problem is as fol- 
lows: Given n agents at positions V{£) = {p^'(£), ■ ■ ■ ,p' ra '(^)} in which they 
form a connected r-disk graph Qdisk( r ), the objective is to find a rich set 
of control inputs for all agents with the property that, at time £ + 1, the 
agents' new positions V(£ + 1) again form a connected r-disk graph Gdiskir). 
We provide a simple, but potentially conservative, solution to this problem 
as follows. 

Definition 4.4 (Connectivity constraint set for groups of agents). 

Consider a group of agents at positions V = {p^ 1 ', ■ ■ . , p^} C M. d . The 
connectivity constraint set of agent i with respect to V is 

X&jkip®,?) = {x e *disk(p H ,<?) \Q € V\ {p^} s.t. ||g-pW|| 2 < r}. • 



In other words, if q\, . . . , q\ are agents' positions whose distance from pW 
is no more than r, then the connectivity constraint set for agent i is the 
intersection of the constraint sets B^(qk + p"), §) for k £ {1, . . . , 1} (see 
Figure 4.2). 




Figure 4.2 An illustration of network connectivity maintenance. The connectivity Adisk- 
constraint set of the white-colored agent is the intersection of the individual 
constraint sets determined by its neighbors. 



The following result is a consequence of Lemma 4.2. 

Lemma 4.5 (Maintaining network connectivity). Consider a group 
of agents at positions V{£) = {p^(£), ■ ■ ■ ,p^(£)} C M. d at time £. If each 
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agent's control vM' {£) takes value in 

u®(£) G ^disk(p [l] (£),V(£)) - p®(£), i G {1, . . . ,n}, 

then, according to the discrete-time motion model (4.1.1): 

(i) each agent remains in its connectivity constraint set, that is, p' t '(£ + 
l)€Af dJflk (pW(i),7'(^)); 

(ii) each edge of £?disk( r ) at V(£) is maintained after the motion step, 
that is, if\\p lil (l)-pV ] (l)h < r, then also \\p^{£+l)-p^{£+l)\\ 2 < 
r; 

(Hi) if ^disk( r ) a t time £ is connected, then £?disk( r ) a t time £ + 1 is 
connected; and 

(iv) the number of connected components of the graph Gdisk{ r ) a t time 
£+1 is equal to or smaller than the number of connected components 
of the graph Gdiskir) at time £. 

Remark 4.6 (Constraints for relative-sensing networks: cont'd). 

Following up on Remark 4.3, the connectivity constraint set in Definition 4.4, 
written in the frame S^, is 

#diak(0*{pf ] ,...,p! n] }) 

x e b(^-, -) \j^i such that \\p^ -p [i] \\ 2 <r\. • 



{■ 



2 '2 



Next, we relax the constraints in Definition 4.4 to provide the network 
nodes with larger, and therefore less conservative, motion-constraint sets. 
Recall from Section 2.2 the relative neighborhood graph £/rjst, the Gabriel 
graph Qq, and the r- limited Delaunay graph Ghv{r). These proximity graphs 
are illustrated in Figure 2.8. From Theorem 2.8 and Proposition 2.9, respec- 
tively, recall that the proximity graphs £/r,n nt/disk( r )> QG^Qdis\i{ r )-, and 
<7ld(0 have the following properties: 

(i) they have the same connected components as Qd\sk{ r )i that is, for all 
point sets V C M. d , all graphs have the same number of connected 
components consisting of the same vertices; and 

(ii) they are spatially distributed over (? disk (?*). 

These mathematical facts have two implications. First, to maintain or de- 
crease the number of connected components of a disk graph, it is sufficient 
to maintain or decrease the number of connected components of any of the 
three proximity graphs £ RN n Qdisk(r), <?c n<?disk(0; and GhT>(r). Because 
each of these graphs is more sparse than the disk graph, that is, they are 
subgraphs of Gdisk{ r ), fewer connectivity constraints need to be imposed. 
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Second, because these proximity graphs are spatially distributed over the 
disk graph, it is possible for each agent to determine which of its neigh- 
bors in <5disk( r ) are also its neighbors in these subgraphs. We formalize this 
discussion as follows. 

Definition 4.7 ((/-connectivity constraint set). Let Q be a proxim- 
ity graph that is spatially distributed over £/disk( r ) and that has the same 
connected components as Gdisk( r )- Consider a group of agents at positions 
V = {p' 1 ', • • • ,p^ n '} C M d . The G -connectivity constraint set of agent i with 
respect to V is 

*disk,g(p H ,P) 

= {x 6 *disk(p [i U) I Q G V s.t. (q,p®) is an edge of G{V)}. • 

Lemma 4.8 (Maintaining connectivity of sparser networks). Let Q 

be a proximity graph that is spatially distributed over Gd\$k{ r ) and that has 
the same connected components as Gdisk( r )- Consider a group of agents at 
positions V{£) = {p'- '(£), ■ ■ ■ ,P^ n '{£)} C K at time £. If each agent's control 
u"(£) takes value in 

u®(£)eX disk ,g{p®(£),V(£)) -p [ %£), t€{l,...,n}, 

then, according to the discrete-time motion model (4.1.1): 

(i) each agent remains in its G -connectivity constraint set; 

(ii) two agents that are in the same connected component of G remain 
at the same connected component after the motion step; and 

(Hi) the number of connected components of the graph G at V(£ + 1) is 
equal to or smaller than the number of connected components of the 
graph GatV (£) . 

The reader is asked to provide a proof of this result in Exercise E4.1. 



4.2.3 Enforcing range-limited line-of-sight links and network connectivity 

Here, we consider the connectivity maintenance problem for a group of 
agents with range-limited line-of-sight communication, as described in Ex- 
ample 3.6. It is convenient to treat directly and only the case of a com- 
pact allowable nonconvex environment QcR 2 contracted into Q$ = {q £ 
Q | dist(q,dQ) > 5} for a small positive 5. We present a solution based on 
designing constraint sets that guarantee that every edge of the range-limited 
visibility graph ^ vis _ diskQi is preserved. 
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(a) 



(b) 



Figure 4.3 Image (a) shows the set Vidisk(p W ; Qs) n.B(|(p M +p b] ), §). Image (b) illus- 
trates the execution of the iterated truncation algorithm. Robots i and 
j are constrained to remain inside the shaded region in (b), which is a convex 
subset of Qs and of the closed ball with center h(p +P ) and radius |. 



We begin with a useful observation and a corresponding geometric algo- 
rithm. Assume that, at time £, robot j is inside the range- limited visibility 
set from pW in Qg, that is, with the notation of Section 2.1.2, 

p[%) G Vidisk(p®(e);Qs) = Vi(p [7] (iy,Q6)nB(pM(l),r). 

This property holds also at time £ + 1 if ||p^(-£ + 1) — pU'(£ + 1)||2 < r and 
[pW(£ + 1), pU'(£ + 1)] c Qs- A sufficient condition is therefore that 

P K (£ + l), p [l \£ + l)^X, 

for some convex subset X of Q$n B^(p^(£)+p^ '(£)), |). Intuitively speak- 
ing, A" plays the role of ^-constraint set for the proximity graph ^vis-disk,Q 5 • 
The following geometric algorithm, given the positions pw and pU> in an 
environment Qs, computes precisely one such convex subset: 

function ITERATED TRUNCATION(pW, pW ;<2,j) 

% Executed by robot i at position p'- 1 ' assuming that robot j is at position 
p^l within range-limited line of sight of p® 

i: x temp ■= Vidi8k(p w ;Q*)nB(i(pW + P [l] ), §) 

2: while c^temp contains a concavity do 

3: u := a strictly concave point of <9Af tem p closest to [p^,p^] 

4: ^temp := <Vtemp fl i^Q s (v) 
5: return A'tgmp 

Note: in step 3: multiple points belonging to distinct concavities may 
satisfy the required property. If so, v may be chosen as any of them. 

Figure 4.3 illustrates an example convex constraint set computed by the 
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iterated truncation algorithm. Figure 4.4 illustrates the step-by-step 
execution required to generate Figure 4.3(b). 




Figure 4.4 From left to right, a sample run of the iterated truncation algorithm. 
The set Aftemp := Vi disk (p w ; Q s ) n S(|(p w +p u] ), §) is shown in Figure 4.3(a). 
The lightly and darkly shaded regions together represent Atemp at the current 
iteration. The darkly shaded region represents Aftemp H Hq s (v), where v is as 
described in step 3: . The outcome of the execution is shown in Figure 4.3(b). 

Next, we characterize the main properties of the iterated truncation 
ALGORITHM. It is convenient to define the set 

J = {(p, q) g Qs x Qs I [p, q] e Qs and \\p - q\\ 2 < r}. 

Proposition 4.9 (Properties of the iterated truncation algorithm). 

Consider the 5 -contraction of a compact allowable environment Qs with k 
strict concavities, and let (jfe' , p^') £ J. The following statements hold: 

(i) The iterated truncation algorithm, invoked with arguments 
{p^ l ',P ,Qs), terminates in at most k steps; denote its output by 

^vis-disk (p w , p m ; Qs)- 

(n) ^is-disk (p®,pW 
(in) AWdisk(p [il ,P M 



Qs) is nonempty, compact and convex. 

Q*) = AWdi B k(p b * 1 ,P w ;Q«). 



(iv) The set-valued map (p,q) i— > AVi S -disk(p, q~, Qs) is closed at J. 

In the interest of brevity, we do not include the proof here and instead 
refer the reader to Ganguli et al. (2009). We just mention that fact (iii) is 
a consequence of the fact that all relevant concavities in the computation of 
^vis-disk (p iP j Qs) are visible from both agents p'- 1 ' and p"'. We are finally 
ready to provide analogs of Definition 4.4 and Lemma 4.5. 

Definition 4.10 (Line-of-sight connectivity constraint set). Consider 
a nonconvex allowable environment Qs and two agents i and j within range- 
limited line of sight. We call ^ v is-disk(p >p' > Qs) the pairwise line-of-sight 
connectivity constraint set of agent i with respect to agent j. Furthermore, 
given agents at positions V = {pM , . . . , pW } c Qs that are all within range- 
limited line of sight of agent i, the line-of-sight connectivity constraint sets 
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of agent i with respect to V is 

*v is -disk(p [l] ,P;Q 5 ) = {xe AWdiBk(p w ,?;Q«) |?eP\ {V l] }}- 

The following result is a consequence of Proposition 4.9. 

Lemma 4.11 (Maintaining network line-of-sight connectivity). Con- 
sider a group of agents at positions V(£) = {p^'(£), ■ ■ ■ , p™ (£)} C Qs at time 
£. If each agent's control u"(£) takes value in 

u®{£) G X vis . disk (p^(£),V(i);Q 5 ) - p^ii), i G {l,...,n}, 
then, according to the discrete-time motion model (4.1.1): 
(i) each agent remains in its constraint set, that is, 

p®(£ + 1) G X vis . d]sk (p^(£),V(£y,Q 5 y, 

(ii) each edge of Q v is-disk,Q s at 'P(^) is maintained after the motion step, 
that is, if pW and pU' are within range-limited line of sight at time 
£, then they are within range-limited line of sight also at time £+ 1; 

(Hi) if Qvm-disk,Q s at V{£) is connected, then £ vis -disk,Q 5 atV(£ + l) is 
connected; and 

(iv) the number of connected components of the graph ^ v is-disk,Q 5 at V{£+ 
1) is equal to or smaller than the number of connected components 
of the graph £ vis _disk,Q 6 at V{£). 

Remark 4.12 (Constraints for relative-sensing networks: cont'd). 

Following up on Remarks 4.3 and 4.6, we consider a relative-sensing network 
with range-limited visibility sensors (see Example 3.16). To compute the 
connectivity constraint set for this network, it suffices to provide a relative 
sensing version of the ITERATED TRUNCATION ALGORITHM: 

function RELATIVE-SENSING ITERATED TRUNCATION ( J/; y env ) 
% Executed by robot i with range-limited visibility sensor: 
robot measurement is y = pf G Vidisk(02; (Qs)i) for j / i 
environment measurement is y env = Vidisk(02; (Qs)i) 

_ -^ / r [ji 
1 



<M;emp ■ — 2/env I I -D ( 2 1 2 ) 

while SA'temp contains a concavity do 

v := a strictly concave point of <9At em p closest to [O2, y] 

'Vtemp '■= 'Vtemp H Hy env \V) 

return X t em P 



The algorithm output is X vis _ disk (0 d , y), for y = pf ] G Vi disk (0 2 ; {Qs)i)- • 
Next, we relax the constraints in Definition 4.10 to provide the network 
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nodes with larger, and therefore less conservative, motion constraint sets. 
Similarly to Section 4.2.2, we seek to enforce the preservation of a smaller 
number of range-limited line-of-sight links, while still making sure that the 
overall network connectivity is preserved. To do this, we recall from Sec- 
tion 2.2 the notion of locally cliqueless graph G\ C) g of a proximity graph 
Q . This proximity graph is illustrated in Figure 2.12. Let us use the short- 
hand notation Gic-vw-disk,Q s = G\c,g^ a . disKQs • From Theorems 2.11(h) and (hi), 
respectively, recall that ^ic-vis-disk,Q 5 has the following properties: 

(i) it has the same connected components as <? v is-disk, Q s > that is, for all 
point sets V C M rf , the graph has the same number of connected 
components consisting of the same vertices; and 

(ii) it is spatially distributed over G Y is-disk,Q 5 ■ 

Because of (i), to maintain or decrease the number of connected components 
of a range-limited visibility graph, it is sufficient to maintain or decrease the 
number of connected components of the sparser graph (?i c -vis-disk,Q a • Because 
of (ii), it is possible for each agent to determine which of its neighbors in 
<?vis-disk,Q 5 are its neighbors also in Q\ c _ v i s -disk, Q 5 ■ We formalize this discussion 
as follows. 

Definition 4.13 (Locally cliqueless line-of-sight connectivity con- 
straint set). Consider a nonconvex allowable environment Qs C M 2 and a 
group of agents at positions V = {p^ 1 ', ■ ■ ■ ,p*- n '} C Q. The locally cliqueless 
line-of-sight connectivity constraint set of agent i with respect to V is 

^k-vis-disk^,^;^) = {x g <*Vis-disk (p w ,<?; Qs) | 

q G V s.t. (q,p [t] ) is an edge of £i c -vis-disk,Q,CP)}- • 

The following result is a direct consequence of the previous arguments. 

Lemma 4.14 (Maintaining connectivity of sparser networks). Con- 
sider a group of agents at positions V(t) = {p^'(i), ■ ■ ■ ,P^ n '(£)} C Qs at time 
£. If each agent's control w 1 ' (£) takes value in 

u®(t) G X lc . vis . disk (p^(£),V(£);Q s ) -p^il), i G {l,...,n}, 

then, according to the discrete-time motion model (4.1.1): 

(i) each agent remains in its locally cliqueless line-of-sight connectivity 
constraint set; 

(ii) two agents that are in the same connected component of ^i c -vis-disk,Q 4 
remain at the same connected component after the motion step; and 

(Hi) the number of connected components of the graph (?ic-vis-disk,Q a at 
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V(£ + 1) is equal to or smaller than the number of connected com- 
ponents of the graph <?i c -vis-disk,Q 5 at V{i). 

4.3 RENDEZVOUS ALGORITHMS 

In this section, we present some algorithms that might be used by a robotic 
network to achieve rendezvous. Throughout the section, we mainly focus on 
the uniform network 5disk of locally connected first-order agents in M rf ; this 
robotic network was introduced in Example 3.4. 



4.3.1 Averaging control and communication law 

We first study a behavior in which agents move toward a position computed 
as the average of the received messages. This law is related to the distributed 
linear algorithms discussed in Section 1.6 and, in particular, to adjacency- 
based agreement algorithms and Vicsek's model. This algorithm has also 
been studied in the context of "opinion dynamics under bounded confidence" 
and is known in the literature as the Krause model. 

We loosely describe the averaging law, which we denote by CC AVE raging; 
as follows: 

[Informal description] In each communication round each agent 
performs the following tasks: (i) it transmits its position and 
receives its neighbors' positions; (ii) it computes the average of 
the point set comprised of its neighbors and of itself. Between 
communication rounds, each robot moves toward the average 
point that it computed. 

We next formulate the algorithm, using the description model of Chap- 
ter 3. The law 1 is uniform, static, and data-sampled, with standard message- 
generation function: 

Robotic Network: 5disk with motion model (4.1.1) in R , 

with absolute sensing of own position, and 
with communication range r 

Distributed Algorithm: AVERAGING 



1 From Definition 3.9 and Remark 3.11 recall that a control and coordination law (1) is uniform 
if processor state set, message-generation, state-transition and control functions are the same for 
each agent; (2) is static if the processor state set is a singleton, i.e., the law requires no memory; 
(3) is data-sampled if if the control functions are independent of the current position of the robot 
and depend only upon the robots position at the last sample time. 
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Alphabet: A = M d U{null} 

function msg(p, i) 
l: return p 

function ctl(p, y) 
l: return avrg({p} U{p rcv d | p rcv d is a non-null message in y}) — p 

An implementation of this control and communication law is shown in 
Figure 4.5 for d = 1. Note that, along the evolution, (1) several robots 
rendezvous, that is, agree upon a common location, and (2) some robots are 
connected at the simulation's beginning and not connected at the simula- 
tion's end (e.g., robots number 8 and 9, counting from the left). Our analysis 




A 
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Figure 4.5 The evolution of a robotic network Sdisk, with r = 1.5, under the averaging 
control and communication law. The vertical axis corresponds to the elapsed 
time, and the horizontal axis to the positions of the agents in the real line. 
The 51 agents are initially randomly deployed over the interval [—15, 15]. 

of the performance of this law is contained in the following theorem, whose 
proof is postponed to Section 4.6.1. 

Theorem 4.15 (Correctness and time complexity of averaging law). 

For d = 1, the network <Sdisk, ^ e ^ aw ^C averaging achieves the task T rn d zvs 
with time complexity 

■f ^(-'rndzvs;^'^- averaging) £ U{n ), 
-L ^(-'rndzvsjLX averaging) £ &l(n). 



4.3.2 Circumcenter control and communication laws 

Here, we define the CRCMCNTR control and communication law for the net- 
work 5disk- The law solves the rendezvous problem while keeping the net- 
work connected. This law was introduced by Ando et al. (1999) and later 
studied by Lin et al. (2007a) and Cortes et al. (2006). 
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We begin by recalling two useful geometric concepts: (i) given a bounded 
set S, its circumcenter CC(S) is the center of the closed ball of minimum 
radius containing S (see Section 2.1.3); (ii) given a point p in a convex set Q 
and a second point q, the from-to-inside map fti(p, q, S) is the point in the 
closed segment \p, q] which is at the same time closest to q and inside S (see 
Section 2.1.1). Finally, recall also the connectivity constraint set introduced 
in Definition 4.4. 

We loosely describe the CRCMCNTR law, denoted by CC CRCMCNTR , as fol- 
lows: 

[Informal description] In each communication round each agent 
performs the following tasks: (i) it transmits its position and re- 
ceives its neighbors' positions; (ii) it computes the circumcenter 
of the point set comprised of its neighbors and of itself. Between 
communication rounds, each robot moves toward this circum- 
center point while maintaining connectivity with its neighbors 
using appropriate connectivity constraint sets. 

We next formulate the algorithm, using the description model of Chap- 
ter 3. The law is uniform, static, and data-sampled, with standard message- 
generation function: 

Robotic Network: 5di s k with discrete-time motion model (4.1.1), 
with absolute sensing of own position, and 
with communication range r, in M. d 

Distributed Algorithm: CRCMCNTR 
Alphabet: A = R d U{null} 

function msg(p, i) 
l: return p 

function ctl(p,y) 
i: Pgoal := CC({p}U{p rcvd | for all non-null p rcvd G y}) 



X := X disk (p, {Prcvd | for all non-null p rcvd £'(/}) 
return fti(p,p goa i, X) - p 



This algorithm is illustrated in Figure 4.6. 

Next, let us note that it is possible and straightforward to implement 
the circumcenter law as a static relative-sensing control law on the relative- 
sensing network with disk sensors 5 d ; sk introduced in Example 3.15: 
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Figure 4.6 An illustration of the execution of the CRCMCNTR algorithm. Each row of 
plots represents an iteration of the law. In each round, each agent computes 
its goal point and its constraint set, and then moves toward the goal while 
remaining in the constraint set. 



Relative Sensing Network: <S^| k with motion model (4.1.2), 
no communication, relative sensing for robot i given by: 
robot measurements y contains pf G 23(02,7") for all j ^ i 

Distributed Algorithm: RELATIVE-SENSING CRCMCNTR 

function ctl(y) 
i: Pgoal := CC({O d }U{p snsd | for all non-null p snsd G y}) 
2: X := X disk (0 d , {p snsd I for all non-null p snsd G y}) 
3-. return fti(O d ,p goa i, X) 



In the remainder of this section, we generalize the circumcenter law in a 
number of ways: (i) we modify the constraint set by imposing bounds on 
the control inputs and by relaxing the connectivity constraint as much as 
possible, while maintaining connectivity guarantees; and (ii) we implement 
the circumcenter law on two distinct communication graphs. Let us note 
that many of these generalized circumcenter laws can also be implemented 
as relative-sensing control laws; in the interest of brevity, we do not present 
the details. 
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4.3.2.1 Circumcenter law with control bounds and relaxed connectivity con- 
straints 

First, assume that the agents have a compact input space U = B(0d, u ma _ x ), 
with u max G K>o. Additionally, we adopt the relaxed (/-connectivity con- 
straint sets as follows. Let Q be a proximity graph that is spatially dis- 
tributed over Qd\sk{ r ) and that has the same connected components as 
£disk(0; examples include £ RN n£ disk (r), Gg H £disk(0, and £ld(0- Recall 
the tj-connectivity constraint set from Definition 4.7. Combining the relaxed 
connectivity constraint and the control magnitude bound, we redefine the 
control function in the CRCMCNTR law to be: 

function ctl(p, y) 

% Includes control bound and relaxed Q -connectivity constraint 
l: Pgoal := CC({p} U{p rcvd | for all non-null p vcvd G y})_ 
2: X := X disk g(p, {prcvd I for all non-null p rcvd G y}) D B(p, u max ) 
3: return fti(p,p goah X) -p 

Second, the circumcenter law can be implemented also on robotic net- 
works with different proximity graphs. For example, we can implement the 
circumcenter algorithm without any change on the following network. 



4.3.2.2 Circumcenter law on the limited Delaunay graph 

We consider the same set of physical agents as in 5 d isk- For r G M>o, 
we adopt as communication graph the r -limited Delaunay graph Qlt>(_i"), 
described in Section 2.2. These data define the uniform robotic network 
<?ld = ({!> ■ • • > n }> T^i ^ld) ; as described in Example 3.4. On this network, 
we implement the CRCMCNTR law without any change, that is, with the same 
message-generation and control function as we did for the implementation 
on the network <S d ; s k. 



4.3.2.3 Parallel circumcenter law on the oo-disk graph 

We consider the network 5oo_ d i s k of first-order robots in M d , connected ac- 
cording to the <?oo-disk(?") graph (see Example 3.4). For this network, we 
define the pll-CRCMCNTR law, which we denoted by CCp LL . CRCMCNTR , by de- 
signing d decoupled circumcenter laws running in parallel on each coordinate 
axis of Mr. As before, this law is uniform and static. What is remarkable, 
however, is that no constraint is required to maintain connectivity (see Ex- 
ercise E4.4). 
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The parallel circumcenter of the set S, denoted by PCC(5), is the center 
of the smallest axis-aligned rectangle containing S. In other words, PCC(S') 
is the component- wise circumcenter of S (see Figure 4.7). We state the 




Figure 4.7 The gray point is the parallel circumcenter of the collection of black points. 
parallel circumcenter law as follows: 

Robotic Network: iSoo_disk with discrete-time motion model (4.1.1) in R , 
with absolute sensing of own position, and 
with communication range r in L°°-metric 

Distributed Algorithm: PLL-CRCMCNTR 
Alphabet: A = R d U{mill} 

function msg(p, i) 
l: return p 

function ctl(p,y) 

i: Pgoal := PCC({p}U{p rcvd | for all non-null p rcvd G y}) 
2: return p goal - p 



4.3.3 Correctness and complexity of circumcenter laws 

In this section, we characterize the convergence and complexity properties 
of the circumcenter law and of its variations. The following theorem sum- 
marizes the results known in the literature about the asymptotic properties 
of the circumcenter law. 

Theorem 4.16 (Correctness of the circumcenter laws). For deM, 

r g M>cb an d £ ^ ^>0; the following statements hold: 
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(i) on the network 5disk; the law CC CRCMC ntr (with control magnitude 
bounds and relaxed Q -connectivity constraints) achieves the exact 
rendezvous task 7^ n d ZV s>' 

(ii) on the network 5ld> the law CCcrcmcntr achieves the e-rendezvous 
task -/e-rndzvs/ and 

(Hi) on the network <Soo-disk> the law CC pll _ C rcmcntr achieves the exact 
rendezvous task T rn d zvs . 

Furthermore, the evolutions o/(S disk ,CC CRCMCNTR ), (<Sld,CC crcmcntr ), and 
(<Soo-disk,CC PLL _ C RCMCNTR) have the following properties: 
(iv) If any two agents belong to the same connected component of the 
respective communication graph at £ £ Z>o, then they continue to 
belong to the same connected component for all subsequent times 
k>L 

(v) For each evolution, there exists P* = (p*, . . . , p*) G (R d ) n such that: 

(a) the evolution asymptotically approaches P* ; and 

(b) for each i,j £ {1, . . . ,n}, either p* = p*-, or \\p* — p*\\2 > T 
(for the networks 5d; s k an d <5ldJ or \\p* — P*j\\oo > r (for the 
network Soo-diskj- 

The proof of this theorem is given in Section 4.6.2. The robustness of 
the circumcenter control and communication laws can be characterized with 
respect to link failures (see Cortes et al., 2006). 

Next, we analyze the time complexity of CC CRCMCNTH ,. As we will see, next, 
the complexity of CC CRCMCN tr differs dramatically when applied to robotic 
networks with different communication graphs. We provide complete results 
for the networks <Sdisk an d <Sld only for the case d = 1. 

Theorem 4.17 (Time complexity of circumcenter laws). Forr £ R>o 

and e £ ]0, 1[, the following statements hold: 

(i) on the network 5di s k; evolving on the real line R (i.e., with d = 1), 

-'-^(-'rndzvs; ^-^-CRCMCNTrJ £ ^\ n ) i 

(ii) on the network 5lDj evolving on the real line R (i.e., with d = 1), 
TC(T( re) _ rndzvs , CCcrcmcntr) G &(n 2 log^e" 1 )) ; and 

(Hi) on the network 5oo-disk; evolving on Euclidean space (i.e., with d e 

™)i -L^i-'rndzvsjLL-PLL-CRCMCNTRJ £ "(W). 

The proof of this result is contained in Martinez et al. (2007b). 
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Remark 4.18 (Analysis in higher dimensions). The results in The- 
orems 4.17(i) and (ii) induce lower bounds on the time complexity of the 
circumcenter law in higher dimensions. Indeed, for arbitrary d > 1, we have 
the following: 

(i) on the network S disk , TC(7; ndzvs ,CC C R CMCNTR ) G O(n); 

(ii) on the network S LD , TC(T( r£ )_ rndzvs ,CC C RCMCNT R ) G 0(n 2 log(ne -1 )). 

We have performed extensive numerical simulations for the case d = 2 
and the network 5 d i s k- We run the algorithm starting from generic initial 
configurations (where, in particular, the robots' positions are not aligned) 
contained in a bounded region of M?. We have consistently obtained that 
the time complexity to achieve Trndzvs with CCcrcmcntr starting from these 
initial configurations is independent of the number of robots. This leads 
us to conjecture that initial configurations where all robots are aligned 
(equivalently, the 1-dimensional case) give rise to the worst possible per- 
formance of the algorithm. In other words, we conjecture that, for d > 2, 
lu(i rn dzvs5 L'L'crcmcntr) = f (n). • 

Remark 4.19 (Congestion effects). As discussed in Remark 3.8, one 
way of incorporating congestion effects into the network operation is to as- 
sume that the parameters of the physical components of the network depend 
upon the number of robots — for instance, by assuming that the communica- 
tion range decreases with the number of robots. Theorem 4.17 presents an 
alternative, equivalent, way of looking at congestion: the results hold un- 
der the assumption that the communication range is constant, but allow for 
the diameter of the initial network configuration (the maximum inter-agent 
distance) to grow unbounded with the number of robots. • 



4.3.4 The circumcenter law in nonconvex environments 

In this section, we adapt the circumcenter algorithm to work on networks 
in planar nonconvex allowable environments. Throughout the section, we 
only consider the case of a compact allowable nonconvex environment Q 
contracted into Q$ for a small positive 8. We present the algorithm in 
two formats: for the communication-based network <S v i s -disk described in 
Example 3.6, and for the relative-sensing network 5*? „ di k described in Ex- 
ample 3.16. 

We modify the circumcenter algorithm in three ways: first, we adopt the 
connectivity constraints described in the previous section for range-limited 
line-of-sight links; second, we further restrict the robot motion to remain 
inside the relative convex hull of the sensed robot positions; and third, we 
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move towards the circumcenter of the constraint set, instead of the circum- 
center of the neighbors positions. The details of the algorithm are as follows: 



Robotic Network: 5 v i s _ d isk with discrete-time motion model (4.1.1), 
absolute sensing of own position and of Qs, and 
communication range r within line of sight (G v i s -disk,Q 5 ) 

Distributed Algorithm: NONCONVEX CRCMCNTR 
Alphabet: A = R 2 U{null} 

function msg(p, i) 
l: return p 



function ctl(p, y) 

X 1 := AVis-diskO, {Prcvd I for all non-null p rcvd G y}; Q s ) 

X 2 := rco({p} U{p rcvd | for all non-null p rcvd G y}; Vi(p; Q s )) 

Pgoai:=CC(^inAf2) 

return fti(p,p goa i, B(p, u max )) - p 



Next, we present the relative sensing version; recall that p\ =02 and that, 
as discussed in Section 3.2.3 in the context of the evolution of a relative 
sensing network with environment sensors, y env denotes the environment 
measurement provided by the range- limited visibility sensor: 

Relative Sensing Network: 5^ s _ disk with motion model (4.1.2) in Qs, 
no communication, relative sensing for robot i given by: 
robot measurements y contains p,| G Vidisk(02; (Qs)i) for j / i 
environment sensing is y env = Vi d isk(02; (Qs)i) 

Distributed Algorithm: NONCONVEX RELATIVE-SENSING CRCMCNTR 

function ctl(y,y e nv) 
i: Xi := A' v is-disk(02,{p S nsd I for all non-null p snsd G y};y e 



envy 
envj 



2: X 2 := rco({0 2 }U{p snsd | for all non-null p snsd G y};y 
3: P goa i:=CC(X l nX 2 )_ 

4: return fti(0 2 ,P g oal, B(0 2 , Umax)) 

Theorem 4.20 (Correctness of the circumcenter law in nonconvex 
environments). For 5 > 0, let Qs be a contraction of a compact allow- 
able nonconvex environment Q. For r G M>o and e G M>o, on the net- 
work <S v i S _ d i s k, the law CC NO nconvex crcmcntr (with control magnitude bounds) 
achieves the e-rendezvous task T e . Tndzvs . Furthermore, the evolution has the 
following properties: 
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(i) If any two agents belong to the same connected component of the 
graph <? v is-disk,<2 5 at £ E Z>o, then they continue to belong to the 
same connected component for all subsequent times k > £. 

(ii) There exists P* = (p*, . . . , p*) £ Q^ such that: 

(a) the evolution asymptotically approaches P* ; and 

(b) for each i,j £ {1, . . . , n}, either p* = p*, or p* and p* are 
not within range-limited line of sight. 

The proof of this result can be found in Ganguli et al. (2009). A brief 
sketch of the proof steps is presented in Section 4.6.4. The complexity of 
the nonconvex CRCMCNTR law has not been characterized. However, note 
that the evolution from any initial configuration such that Q v \s,Q s is complete 
is also an evolution of the CRCMCNTR law discussed in Section 4.3.2, and 
hence Theorem 4.17(i) induces a lower bound on the time complexity. 

4.4 SIMULATION RESULTS 

In this section, we illustrate the execution of some circumcenter control and 
communication laws introduced in this chapter. The CRCMCNTR law is im- 
plemented on the networks <Sdisk; ^>ld> and 5oo-disk in Mathematica® as a 
library of routines and a main program running the simulation. The pack- 
ages PlanGeom.m and SpatialGeom.m contain routines for the computation 
of geometric objects in M 2 and M 3 , respectively. These routines are freely 
available at the book webpage http://coordinationbook.info 

First, we show evolutions of (5disk> CRCMCNTR) in two and three dimen- 
sions in Figures 4.8 and 4.9, respectively. Measuring displacements in me- 
ters, we consider random initial positions over the square [—7,7] x [—7,7] 
and the cube [—7, 7] x [—7, 7] x [—7, 7]. The 25 robotic agents have a com- 
munication radius r = 4 and a compact input space U = B(0d, u max ), with 
Umax = 0.15. As the simulations show, the task 7^ n dzvs is achieved, as guar- 
anteed by Theorem 4.16(i). 

Second, within the same setup, we show an evolution of (<Sldj CRCMCNTR) 
in two dimensions in Figure 4.10. As the simulation shows, the task 7^_ rn d Z v S 
is achieved, as guaranteed by Theorem 4.16(ii). 

Third, we show an evolution of (5oo_disk) pll-CRCMCNTr) in two dimen- 
sions in Figure 4.11. As the simulations show, the task 'Trndzvs is achieved, 
as guaranteed by Theorem 4.16(iii). 

Finally, we refer the interested reader to Ganguli et al. (2009) for simula- 
tion results for the NONCONVEX CRCMCNTR algorithm. 
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Figure 4.8 The evolution of (Sdisk, CRCMCNTr) with n — 25 robots in 2 dimensions: (a) 
shows the initial connected network configuration; (b) shows the evolution of 
the individual agents until rendezvous is achieved. 



4.5 NOTES 



The rendezvous problem and the circumcenter algorithm were originally 
introduced by Ando et al. (1999). The circumcenter algorithm has been 
extended to other control policies, including asynchronous implementations, 
in Lin et al. (2007a, b). The circumcenter algorithm has been extended 
beyond planar problems to arbitrary dimensions in Cortes et al. (2006), 
where its robustness properties are also characterized. Regarding Theo- 
rem 4.16, the results on 5disk appeared originally in Ando et al. (1999); the 
results on 5ld and on 5oo-disk appeared originally in Cortes et al. (2006) and 
in Martinez et al. (2007b), respectively. Variations of the circumcenter law 
in the presence of noise and sensor errors are studied in Martinez (2009b). 
The continuous-time version of the circumcenter law, with no connectivity 
constraints, is analyzed in Lin et al. (2007c). Continuous-time control laws 
for groups of robots with simple first-order dynamics and unicycle dynamics 
are proposed in Lin et al. (2004, 2005) and Dimarogonas and Kyriakopou- 
los (2007). In these works, the inter-robot topology is time dependent and 
assumed a priori to be connected at all times. Rendezvous under communi- 
cation quantization is studied in Fagnani et al. (2004) and Carli and Bullo 
(2009). Rendezvous for unicycle robots with minimal sensing capabilities 
is studied by Yu et al. (2008). Relationships with classic curve-shortening 
flows are studied by Smith et al. (2007). 



Rendezvous has also been studied within the computer science literature, 
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Figure 4.9 The evolution of (Sdisk, CRCMCNTr) with n — 25 robots in 3 dimensions: (a) 
shows the initial connected network configuration; (b) shows the evolution of 
the individual agents until rendezvous is achieved. 



where the problem is referred to as the "gathering," or point formation, 
problem. Flocchini et al. (1999) and Suzuki and Yamashita (1999) study the 
point formation problem under the assumption that each robot is capable 
of sensing all other robots. Flocchini et al. (2005) propose asynchronous 
algorithms to solve the gathering problem, and Agmon and Peleg (2006) 
study the solvability of the problem in the presence of faulty robots. 

Multi-robot rendezvous with line-of-sight sensors is considered in Roy and 
Dudek (2001), where solutions are proposed based on the exploration of the 
unknown environment and the selection of appropriate rendezvous points 
at pre-specified times. Hayes et al. (2003) also consider rendezvous at a 
specified location for visually guided agents, but the proposed solution re- 
quires each agent to have knowledge of the location of all other agents. The 
problem of computing a multi-robot rendezvous point in polyhedral sur- 
faces made of triangular faces is considered in Lanthier et al. (2005). The 
perimeter-minimizing algorithm presented by Ganguli et al. (2009) solves 
the rendezvous problem for sensor-based networks with line-of-sight range- 
limited sensors in nonconvex environments. 

Regarding the connectivity maintenance problem, a number of works have 
addressed the problem of designing a coordination algorithm that achieves 
a general, non-specified task while preserving connectivity. The centralized 
solution proposed in Zavlanos and Pappas (2005) allows for a general range 
of agent motions. The distributed solution presented by Savla et al. (2009b) 
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Figure 4.10 The evolution of (Sld, CRCMCNTr) with n = 25 robots in 2 dimensions: (a) 
shows the initial connected network configuration; (b) shows the evolution of 
the individual agents until rendezvous is achieved. 



gives connectivity maintaining constraints for second-order control systems 
with input magnitude bounds. A distributed algorithm to perform graph 
rearrangements that preserve the connectivity is presented in Schuresko and 
Cortes (2007). Connectivity problems have been studied also in other con- 
texts. Langbort and Gupta (2009) study the impact of the connectivity 
of the interconnection topology in a class of network optimization prob- 
lems. Spanos and Murray (2005) generate connectivity-preserving motions 
between pairs of formations. Ji and Egerstedt (2007) design Laplacian-based 
control laws to solve formation control problems while preserving connec- 
tivity. Various works have focused on designing the network motion so that 
some desired measure of connectivity (e.g., algebraic connectivity) is max- 
imized under position constraints. Boyd (2006) and de Gennaro and Jad- 
babaie (2006) consider convex constraints, while Kim and Mesbahi (2006) 
deal with a class of nonconvex constraints. Zavlanos and Pappas (2007b) 
use potential fields to maximize algebraic connectivity. 

A continuous-time version of the averaging control and communication law 
is also known as the Hegselmann-Krause model for "opinion dynamics under 
bounded confidence" (see Hegselmann and Krause, 2002; Lorenz, 2007). In 
this model, each agent may change its opinion by averaging it with that of 
neighbors who are in an e-confidence area. In other words, the difference 
between the agent's opinion and those of its neighbors' should be bounded 
by £. A similar model where the communication between agents is random 
is the Deffuant- Weisbuch model, inspired by a model of dissemination of 
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Figure 4.11 The evolution of (Soo-disk, PLL-CRCMCNTR) with n = 25 robots in 2 dimen- 
sions: (a) shows the initial connected network configuration; (b) shows the 
evolution of the individual agents until rendezvous is achieved. 



culture (see Deffuant et al., 2000; Axelrod, 1997). 

4.6 PROOFS 

This section gathers the proofs of the main results presented in the chapter. 

4.6.1 Proof of Theorem 4.15 

Proof. One can easily prove that, along the evolution of the network, the or- 
dering of the agents is preserved, that is, the inequality p^> < p^' is preserved 
at the next time step. However, links between agents are not necessarily pre- 
served (see, e.g., Figure 4.8). Indeed, connected components may split along 
the evolution. However, merging events do not occur. Consider two contigu- 
ous connected components C\ and C2 of <?disk(0> with C\ to the left of C2. 
By definition, the rightmost agent in the component C\ and the leftmost 
agent in the component C2 are at a distance strictly larger than r. Now, 
by executing the algorithm, they can only but increase that distance, since 
the rightmost agent in C\ will move to the left, and the leftmost agent in 
C2 will move to the right. Therefore, connected components do not merge. 

Consider first the case of an initial network configuration for which the 
communication graph remains connected throughout the evolution. Without 
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loss of generality, assume that the agents are ordered from left to right ac- 
cording to their identifier, that is, pW(0) < • • • < p^ n '(0). Let a E {3, . . . , n} 
have the property that agents {2, . . . , a — 1} are neighbors of agent 1, and 
agent a is not. (If, instead, all agents are within an interval of length r, then 
rendezvous is achieved in 1 time instant, and the statement in theorem is 
easily seen to be true.) Note that we can assume that agents {2, . . . , a — 1} 
are also neighbors of agent a. If this is not the case, then those agents that 
are neighbors of agent 1 and not of agent a rendezvous with agent 1 at the 
next time instant. At the time instant £ = 1, the new updated positions 



satisfy 



p [11 (i) = ^-rX> [fc] (o), 

a — 1 ^-^ 



k=i 



ph]< 



where * denotes a certain unimportant point. 

Now, we show that 

p W(a-l)-pM(0)> - r (4.6.1) 

a{a — 1) 

Let us first show the inequality for a = 3. Because of the assumption that 
the communication graph remains connected, agent 2 is still a neighbor of 
agent 1 at the time instant £ = 1. Therefore, p [1] (2) > ^(p [1] {l) + p [2] (l)), 
and from here we deduce 

P [1] (2)-P [1] (0)>^(p [2] (l)-P [1] (0)) 

> l(l(p ll] (o)+P l2] (o)+P m (o))- P [1] (o)) > 1(P [3] (0)- P M(0)) > r -. 

Let us now proceed by induction. Assume that inequality (4.6.1) is valid for 
a — 1, and let us prove it for a. Consider first the possibility, when at the 
time instant £ = 1, that the agent a — 1 is still a neighbor of agent 1. In 
this case, pM(2) > ^-j- Ylk=i P (1)> anc ^ f rom nere we deduce 



pW(2)-pW(0) > -^—(p^-^{l)-p^(0)) 
a — 1 V / 

>^-(if>M(0)-pW(0) N 
fc=i 

> ^^r(p [a] (o)-P [1] (o)) > -t^—tv 

which, in particular, implies (4.6.1). Consider then the case when agent 
a — 1 is not a neighbor of agent 1 at the time instant £ = 1. Let (3 < a 
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such that agent j3 — 1 is a neighbor of agent 1 at £ = 1, but agent j3 is not 



Since /3 < a, we have by induction p^'((3) — pW(l) > fl( .J'_ 1 ^ . From here, we 
deduce that pW(a - 1) -p [1] (0) > 



«(a— 1) ' 



It is clear that after £\ = a — 1, we could again consider two complementary 
cases (either agent 1 has all others as neighbors or not) and repeat the same 
argument once again. In that way, we would find £2 such that the distance 
traveled by agent 1 after £2 rounds would be lower bounded by zrrzrzT) ■ 
Repeating this argument iteratively, the worst possible case is one in which 
agent 1 keeps moving to the right and, at each time step, there is always 
another agent which is not a neighbor. Since the diameter of the initial 
condition Pq is upper bounded by (n — l)r, in the worst possible situation, 
there exists some time £k such that r J[\ = 0(r(n — 1)). This implies that 

k = 0((n — l) 2 n). Now we can upper bound the total convergence time £k 
by £k = Si=i on — k < k(n — 1), where we have used that a» < n for all 
i G {1, . . . ,n}. From here, we see that £\~ = 0((n — l) 3 n), and hence we 
deduce that in 0(n(n — l) 3 ) time instants there cannot be any agent which 
is not a neighbor of the agent 1. Hence, all agents rendezvous at the next 
time instant. Consequently, 

I C(T m d ZV s) £-6 averaging) Pq) = 0[n{n — 1) ). 

Finally, for a general initial configuration Pq, because there are a finite 
number of agents, only a finite number of splittings (at most n — 1) of the 
connected components of the communication graph can take place along the 
evolution. Therefore, we conclude that TC^ndzvsjCC averaging) = 0(n°). 

Let us now prove the lower bound. Consider an initial configuration Pq g 
M ra where all agents are positioned in increasing order according to their 
identity, and exactly at a distance r apart — say, p^ +1 '(0) — pW(0) = r, i G 
{1, . . . , n — 1}. Assume for simplicity that n is odd — when n is even, one 
can reason in an analogous way. Because of the symmetry of the initial 
condition, in the first time step, only agents 1 and n move. All the remaining 
agents remain in their position, because it coincides with the average of its 
neighbors' position and its own. At the second time step, only agents 1, 2, 
n — 1, and n move, and the others remain static because of the symmetry. 
Applying this idea iteratively, one deduces that the time step when agents 
^^— and ^^ move for the first time is lower bounded by ^- . Since both 
agents have still at least a neighbor (agent ^— ), the task T vn d zvs has not been 
achieved yet at this time step. Therefore, TC(^ I1{ j zvs , CC averaging > -Po) > 
lk ^-, and the result follows. ■ 



203 



"Distributed Control of Robotic Networks" by F. Bullo, J. Cortes and S. Martinez 
Copyright © 2006-2009. Manuscript under contract. This version: March 22, 2009 



DCRN March 22, 2009 



4.6.2 Proof of Theorem 4.16 

Proof. We divide the proof of the theorem into three groups, one per net- 
work. 

STEP 1: Facts on (Sdisk,CC CRC MCNTR)- Fact (iv) for (<Sdisk,CCcRCMCNTR.) is 
a direct consequence of the control function definition of the CRCMCNTR law 
and Lemma 4.8. 

Let us show fact (i). Because Q has the same connected components 
as £?disk( r )> fact (i y ) implies that the number of connected components of 
£?disk(r) can only but decrease. In other words, the number of agents in 
each of the connected components of <?disk( r ) is non-decreasing. Since there 
is a finite number of agents, there must exist £q such that the identity of 
the agents in each connected component of <?disk( r ) is fixed for all £ > £q 
(that is, no more agents are added to the connected component afterwards). 
In what follows, without loss of generality, we assume that there is only 
one connected component after £q, i.e., the graph is connected (if this is 
not the case, then the same argument follows through for each connected 
component). 

We prove that the law CC C rcmcntr (with control magnitude bounds and re- 
laxed (/-connectivity constraints) achieves the exact rendezvous task 7^ n d ZV s 
in the following two steps: 

(a) We first define a set- valued dynamical system ((R d ) n , (R d ) n ,T) such 
that the evolutions of (5disk>CCcRCMCNTR), starting from an initial 
configuration where £?disk( r ) is connected, are contained in the set 
of evolutions of the set-valued dynamical system. 



(b) We then establish that any evolution of ((R ) n , (R )", T) converges 
to a point in diag((R d ) n ) (the point might be different for different 
evolutions). 

This strategy is analogous to the discussion regarding the Overapproxima- 
tion Lemma for time-dependent systems in Section 1.3.5. 

Let as perform (a). Given a connected graph G with vertices {1, . . . , n}, let 
us consider the constraint sets and goal points defined with respect to G. In 
other words, given P = (pi, . . . ,p n ) £ (R ) n , define for each i £ {1, . . . , n}, 

(Pgoal)* := CC({ Pt }U{p 3 I j £ M G (i)}), 

Xi := {W-^, TJ P) I 3 € M G (i)} DB( Pl , u max ), 

where ri(P) = max{r, max{||pj — Pjlb | j £ ■^ v g(^)}}- Since two neighbors 
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according to G can be arbitrarily far from each other in R , we need to 
modify the definition of the constraint set with the radius r^ (P) to prevent 
X{ from becoming empty. Note that if \\pi — Pj\\2 < r for all j G A/g*(*)> then 
Ti{P) = r and, therefore, Xi = Xdi s k,G(Pii P) H B(pi,u max ). It is also worth 
observing that both (p goa l)« and <-tj change continuously with (pi, . . . ,Pn)- 



Define the map fti G : (R d ) n -> (R d ) n by 

fti G (pi, . . . ,p n ) = (fti(pi, (pgoal)l, Afi), . . . , fti(p n , (Pgoal)n, ^n))- 

One can think of fti G as a circumcenter law where the neighboring relation- 
ships among the agents never change. Because fti is continuous, and (p goa i)i 
and Xi, i G {l,...,n}, change continuously with (pi, . . . ,p n ), we deduce 
that fti G is continuous. 

We now define a set- valued dynamical system ((R ) n , (R ) n ,T) through 
the set-valued map T : (R d ) n ^ (R d )™ given by 

T(pi, . . . ,p n ) = {ftiaipi, ■ ■ ■ ,p n ) I G is a strongly connected digraph}. 

Note that the evolution of the CRCMCNTR law using a proximity graph such 
as ^disk(^) is just one of the multiple evolutions described by this set-valued 
map. This concludes (a). 

Let us now perform (b). To characterize the convergence properties of 
the set-valued dynamical system, we use the LaSalle Invariance Principle in 
Theorem 1.21. With the notation of this result, we select W = (R d ) n . This 
set is clearly strongly positively invariant for ((R rf ) n , (R rf ) n ,T). 

Closedness of the set-valued map. Since fti(j is continuous for each di- 
graph G and there is a finite number of strongly connected digraphs on the 
vertices {1, . . . ,n}, Exercise El. 9 implies that T is closed. 

Common Lyapunov function. Define the function Vdiam : (R ) n — > R>o 
by 

Vdiam(-P) = maxilla -pj\\ I i,j G {l,...,n}}. 

With a slight abuse of notation, we denote by co(P) the convex hull of 
{pi, . . . ,p n } c R d . Note that Vdi am (P) = diam(co(P)). The function Vdiam 
has the following properties: 

(i) Vdiam is continuous and invariant under permutations of its argu- 
ments. 

(ii) Vdiam(-P) = if and only if P G diag((R d ) n ), where we recall that 
diag((R a! ) n ) = {(pi,...,p n ) G (K d ) n | p^ = ■■■ = pN G R d } de- 
notes the diagonal set of (R )™. This fact is an immediate conse- 
quence of the fact that, given a set S C (R ) n , diam(co(5)) = if 
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and only if S is a singleton. 

(iii) Vdi am is non-increasing along T on (R ) n . Consider a finite set 
of points S G F((R ) n ) and let 00(5") be its circumcenter. From 
Lemma 2.2(i), we have CC(5) G co(S). Therefore, for any strongly 
connected digraph G, we have that co(ftic(-P)) C co(P) for any 
P G (R d ) n . Since for any two sets Si, S 2 C (R d ) n such that co(S 2 ) C 
00(52) it holds that V d i am (S 2 ) < V d i am (5i), then Vdi am (fti G (P)) < 
^diam(P) f° r an y strongly connected digraph G, which implies that 
Vdiam is non-increasing along T on (R rf ) n . 

Bounded evolutions. Consider any initial condition (pi(0), . . . ,p n (0)) G 
(R d )™. For any strongly connected digraph, G, we have 

M G ( Pl (£), . . . ,p n (£)) G co(pi(0), . . . ,p„(0)), 

for all £ G Z>o- Therefore, any evolution of the set-valued dynamical system 
((M. d ) n ,(M. d ) n ,T) is bounded. 

Characterization of the invariant set. By the LaSalle Invariance for set- 
valued dynamical systems in Theorem 1.21, any evolution with initial con- 
dition in W = (R ) n approaches the largest weakly positively invariant set 
M contained in 

{P G (R d ) n \3P'e T(P) such that V diam (P') = V di&m (P)}. 



We show that M = diag((R d ) n ). Clearly, diag((R d ) n ) c M. To prove 
the other inclusion, we reason by contradiction. Assume that P G M \ 
diag((R d ) n ) and, therefore, Vdi am (P) > 0- Let G be a strongly connected di- 
graph and consider ftic(P)- For each i G {1, . . . , n}, we distinguish two cases 
depending on whether pi is or is not a vertex of co(P). If pi Ve(co(P)), 
then Lemma 2.2(i) implies that fti(pj, {p g0 a,i)i, Xi) G co(P) \ Ve(co(P)). 

If Pi G Ve(co(P)), then we must take into consideration the possibility of 
having more than one agent located at the same point. If the location of 
all the neighbors of i in the digraph G coincides with pi, then agent i will 
not move, and hence fti(pj, (p goa ,i)i, Xi) G Ve(co(P)). However, we can show 
that the application of ftic strictly decreases the number of agents located 
at pi. Let us denote this number by Ni, that is, 

Ni = \{j G {1, . ..,n} I pj = pi and pj G {pi, . . . ,p n }}\- 

Since the digraph G is strongly connected, there must exist at least an 
agent located at pi with a neighbor which is not located at pi (otherwise, 
all agents would be at pi, which is a contradiction). In other words, there 
exist i*, j G {1, . . . ,n} such that p^ = pi, pj 7^ pi, and j G A/g(«*)- By 
Lemma 2.2(i), we have that (p g0 al)i» G co(P) \ Ve(co(P)) and, therefore, 



206 



"Distributed Control of Robotic Networks" by F. Bullo, J. Cortes and S. Martinez 
Copyright © 2006-2009. Manuscript under contract. This version: March 22, 2009 



DCRN March 22, 2009 



(Pgoal)i, 7^ Pi,- Combining this with the fact that 

{Pi/U-frj | j 6 A/" G (i)} C B( Pi ,,r u (P)), 

we can apply Lemma 2.2(h) to ensure that ]pi t , (p g oai)i. [ has nonempty in- 
tersection with Xi t . Therefore, fti(pj„, (p g0 ai)i, j %i,) £ co(P) \ Ve(co(P)), 
and the number iV, of agents located at pi decreases at least by one with 
the application of fti G . 

Next, we show that, after a finite number of steps, no agents remain at 
the location pi. Define N = max{iVi | pi £ Ve(co(P))} < n — 1. Then 
all agents in the configuration fti Gl (fti G2 (. • • ^G N (P))) are contained in 
co(P) \ Ve(co(P)), for any collection of strongly connected directed graphs 
G ± ,...,G N . Therefore, diam(co(fti Gl (fti Ga (. . . fti Gjv (P))))) < diam(co(P)), 
which contradicts the fact that M is weakly invariant. 

Point convergence. We have proved that any evolution of ((R d ) n , (R d ) n , T) 
approaches the set diag((R rf ) n ). To conclude the proof, let us show that the 
convergence of each trajectory is to a point, rather than to the diagonal set. 
Let {P(£) | £ G Z>o} he an evolution of the set-valued dynamical system. 
Since the sequence is contained in the compact set co(P(0)), there exists a 
convergent subsequence {P(£k) | k £ Z>o}, that is, there exists pel such 
that 

Km P(£ k ) = (p,...,p). (4.6.2) 

Let us show that the whole sequence {P(£) \ £ £ Z>o} converges to (p, . . . ,p). 
Because of (4.6.2), for any e > 0, there exists fco such that for k > ko one has 
co(P(£k)) C B(p,e/-\/n). From this, we deduce that co(P(£)) C B(p, £/\/n) 
for all £ > £/. , which in turn implies that ||P(^) — (p, ■ ■ ■ ,p)\\2 < £ for all 
£ > £k i as claimed. This concludes (b). 

The steps (a) and (b) imply that any evolution of (5disk 5 CC CRCMCNTR ) start- 
ing from an initial configuration where (?disk( r ) is connected converges to a 
point in diag((M d ) n ). To conclude the proof of fact (i), we only need to es- 
tablish that this convergence is in finite time. This last fact is a consequence 
of Exercise E4.5. 

Fact (v) for (5disk]CC CRCM cNTR) is a consequence of facts (i) and (iv). 

STEP 2: Facts on (<Sld , CCcrcmcntr) ■ The proof of facts (i), (iv), and (v) 
for (5ld,CC C rcmcntr) is analogous to the proof of these facts for the pair 
('5disk)CCcRCMCNTR.) ) and we leave it to the reader. 

STEP 3: Facts on («S 00 _di s k,CCp LL _ CR c M cNTR)- From the expression for 
the control function of CCpll-crcmcntr> we deduce that the evolution un- 
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der CC PLL _ CRCMCNTR of the robotic network 5oo_disk (in d dimensions) can be 
alternatively described as the evolution under CCcrcmcntr of d robotic net- 
works 5disk i n ^ ( see Exercise E4.4). Therefore, facts (i), (iv), and (v) for 
the pair (<->oo-disk) CCpll-crcmcntr) follow from facts (i), (iv), and (v) for the 

pair (Odisk)^-L-CRCMCNTR)- 



4.6.3 Proof of Theorem 4.17 

Proof. Let P = (p [11 (0), . . . ,p M (0)) 6 K n denote the initial condition. 

Fact (i). For d = 1, the connectivity constraints on each agent % € {1, . . . , n} 
imposed by the constraint set 

<*disk(p W , {Prcvd | for all non-null p rcvd G y W }) (4.6.3) 

are superfluous. In other words, the goal configuration resulting from the 
evaluation by agent i of the control function of the CRCMCNTR law belongs 
to the constraint set in (4.6.3). Moreover, the order of the robots on the 
real line is preserved from one time step to the next. Both observations are 
a consequence of Exercise E4.3. 

Let us first establish the upper bound in fact (i). Consider the case when 
£/disk( r ) is connected at Pq. Without loss of generality, assume that the 
agents are ordered from left to right according to their identifier, that is, 
pW(0) < ■ ■ • < pt n '(0). Let a £ {3, . . . , n} have the property that agents 
{2, . . . , a — 1} are neighbors of agent 1, and agent a is not. (If, instead, all 
agents are within an interval of length r, then rendezvous is achieved after 
one time step, and the upper bound in fact (i) is easily seen to be true.) 
Figure 4.12 presents an illustration of the definition of a. Note that we can 




Figure 4.12 The definition of a £ {3, . . . ,n} for an initial network configuration. 

assume that agents {2, . . . , a — 1} are also neighbors of agent a. If this is not 
the case, then those agents that are neighbors of agent 1 and not of agent 
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a, rendezvous with agent 1 after one time step. At the time instant 
the new updated positions satisfy 



rn m _ p [1] (Q)+p [a - 1] (o) 
p { > 2 



p [7] (1)g 



p[i] (0) + pW (0) pW (0) + pM (0) + r 



2 (p[«-i](0) -pW(0)) < ir. Analogously, we deduce pW(2) -pW(l) < \r 



for 7 G {2,..., a — 1}. These equalities imply that pW(l) — pW(0) 
|(p[a-l]( 

and, therefore, 

pW(2)-pW(0) <r. (4.6.4) 

On the other hand, from p' 1 ' (2) G [^ (p' 1 ^ (1) + p' a_1 ^ (1)) , *] (where the sym- 
bol * represents a certain unimportant point in R), we deduce 

pM(2)-pM(0) > I(pW(l)+p[«- 1 ](l)) -pW(0) 
>^,'°-'(l)-Ao))>l( ''" 1 ' »7 l< "C) - i) M(0) 

= j(p W (0)-P |1| (0))> jr. (4.6.5) 

Inequalities (4.6.4) and (4.6.5) mean that, after at most two time steps, 
agent 1 has traveled a distance greater than r/4. In turn, this implies that 

1 4 

- diam(co(P )) < TC(7; ndzvs ,CC CRCMCNTH , P ) < - diam(co(P ))- 

If <5disk( r ) is not connected at Po, note that along the network evolution, 
the connected components of the r-disk graph do not change. Using the 
previous characterization on the distance traveled by the leftmost agent of 
each connected component in at most two time steps, we deduce that 

4 
TC(7; ndzvs ,CC CRCM cNTR,-Po) < - max diam(co(C)), 

r ceC(Po) 

where C{Pq) denotes the collection of connected components of <?disk( r ) at Po- 
The connectedness of each C G C(Pq) implies that diam(co(C)) < (n — l)r, 
and therefore, TC(7; ndzvs ,CC CRCMCNTR ) G 0(n). 

The lower bound in fact (i) is established by considering Po G M n such 
that pL J+1 J (0) — pV' (0) = r, i G {1, . . . , n — 1}. For this configuration, we have 
diam(co(P )) = (n-l)r and, therefore, TC(7; ndzvs ,CC CRCMCNTR , P ) > n-1. 

Fact (ii). In the r-limited Delaunay graph, two agents on the line that are 
at most at a distance r from each other are neighbors if and only if there 
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are no other agents between them. Also, note that the r-limited Delaunay 
graph and the r-disk graph have the same connected components (cf . , Theo- 
rem 2.8). An argument similar to the one used in the proof of fact (i) above 
guarantees that the connectivity constraints imposed by the constraint sets 
<^disk (p , {Prcvd | for all non-null p rcv d £ V }) are again superfluous. 



Consider first the case when £/LD( r ) is connected at Po. Note that this 
is equivalent to <?disk( r ) being connected at Po- Without loss of generality, 
assume that the agents are ordered from left to right according to their 
identifier, that is, pW(0) < • • • < p^ n '(0). The evolution of the network under 
CC CRCMCNTR can then be described as the discrete-time dynamical system 

1 



P 



[i] 



(£+1)= (pW^+pPI^)), 



V 



W(£ + l)= (p[i](i) +p [3](^)) j 



Note that this evolution respects the ordering of the agents. Equivalently, 
we can write P{£ + 1) = AP(£), where A £ R" xn is the matrix given by 



.1 



Note that A = ATridj 








1 
■~> 




1 

2 




1 

2 









1 

2 



I 

2J 



,0), as defined in Section 1.6.4. Theorem 1.80(i) 
implies that, for P ave = ^I^Pq, we have that lim^^ +00 P(£) = P ave ln, and 
that the maximum time required for \\P(£) — P a veln|| 2 ^ vW^b ~ -Pave In II 2 
(over all initial conditions in W 1 ) is 0(n 2 log?7 _1 ). (Note that this also 
implies that agents rendezvous at the location given by the average of their 
initial positions. In other words, the asymptotic rendezvous position for this 
case can be expressed in closed form, as opposed to the case with the r-disk 
graph.) 



Next, let us convert the contraction inequality on 2-norms into an appro- 
priate inequality on oo-norms. Note that diam(co(Po)) < ( n — l) r because 
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<?ld(0 is connected at Pq. Therefore, 



Pfl — P»vpl 



ave x oo 



max Ip'- 1 ' (0) 

i£{l,...,n} 



< \p [1] {0)-p [n] (0)\ < (n-l)r. 



For I of order n 2 log r] 1 , we use this bound on ||Pq — P ave l ||oo and the basic 
inequalities ||u||oo < 1Mb < V^IMloo for all v £ M n , to obtain 

||P(£) - Pavel Hoc < \\P{£) - P ave l|| 2 < r?||Po - P a vel|| 2 
< ?7Vn||Po - P av el||oo < r]y/n(n - l)r. 



This means that (re)-rendezvous is achieved for r]yfn(n — l)r = re, that is, 
in time 0(n 2 logr]~ 1 ) = 0(n 2 \og{ne~ 1 )). 

Next, we show the lower bound. Consider the unit-length eigenvector 
4 T (sin^ T ,...,sin^) T £ W 1 of Trid n _i(|,0, \) corresponding 

to the largest singular value cos(^). For fj, = ~ rn 5 ' 2 , we then define the 
initial condition 



M P 4 




v n -i 



One can show that p^(0) < p^ +1 l(0) for i e {1, 



,n 



1}, that P av e = 0, 



and that max{p' J+1 '(0) — p^'(0) \ i £ {1, . . . ,n — 1}} < r. Using Lemma 1.82 
and because ||u>||oo < HHk < v^HHIoo f° r au w £ H^N we compute 



|Pb| 



f/i 



5/2 



> 



10^/2 

VII 



P+ 





v„_i 



> 



rn - 



CO 

rn 



10\/2 



P4 




v„_i 



2 



V n-1 2 



lOvV " 10V2 

The trajectory P(^) = (cos(-))^Po therefore satisfies 

i™iU = (cosg))VolU> T ^ ! (co ^ 

Therefore, ||P(T)||oo is larger than ^re so long as 1 / - n(cos(^)) £ > ^e, that 
is, so long as 

£< logCe- 1 ?!) - log(5x/2) 
-log(cos(*)) 

In exercise E4.7, the reader is asked to show that the asymptotics of this 
bound correspond to the lower bound in fact (i). 

Now consider the case when £/ld(?") is not connected at Pq. Note that the 
connected components do not change along the network evolution. There- 
fore, the previous reasoning can be applied to each connected component. 
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Since the number of agents in each connected component is strictly less than 
n, the time complexity can only but improve. Therefore, we conclude that 

TC(7; ndzvs ,CC C RCMCNTR.) e G(n 2 log(ne -1 )). 

Fact (in). Recall from the proof of Theorem 4.6.2 that the evolution under 
CC PLL _ CRCMCNTH of the robotic network <Soo-disk (i n d dimensions) can be alter- 
natively described as the evolution under CC 0RCMCNTH of d robotic networks 
<5disk hi M (see Exercise E4.4). Fact (iii) now follows from fact (i). ■ 



4.6.4 Proof sketch of Theorem 4.20 

Here, we only provide a sketch of the proof of Theorem 4.20. Fact (i) is a 
consequence of the control function definition of the NONCONVEX CRCMCNTR 
law in Section 4.3.4 and Lemma 4.11. Fact (ii) follows from the fact that 
the law CC N onconvex crcmcntr (with control magnitude bounds) achieves the 
£-rendezvous task 7^-mdzvs and fact (i). 

To show that, on the network <S v is-disk) the law CC NO nconvex crcmcntr (with 
control magnitude bounds) achieves the e-rendezvous task T £ _ rn d zvs , one can 
follow the same overapproximation strategy that we used in the proof of 
Theorem 4.16, STEP 1:, that is, 

(a) define a set-valued dynamical system (Q^, Q^, T) such that the evo- 
lutions of (S vis _ disk ,CC NO NcoNVEx crcmcntr) starting from an initial 
configuration where G v i s -disk,Q s is connected are contained in the set 
of evolutions of the set- valued dynamical system; and 

(b) establish that any evolution of (Q^Q^T) converges to a point 
in diag(Q^) (note that the point might be different for different 
evolutions). 

We refer to Ganguli et al. (2009) for a detailed development of this proof 
strategy. Here, we only remark that in order to carry out (b), the proof uses 
the LaSalle Invariance Principle in Theorem 1.21, with the perimeter of the 
relative convex hull of a set of points as Lyapunov function. 

4.7 EXERCISES 

E4.1 (Maintaining connectivity of sparser networks). Prove Lemma 4.8. 

Hint: Use Lemma 4-8 and the fact that Q and Gd\sk{r) have the same connected 
components. 

E4.2 (Maintaining network line-of-sight connectivity). Prove Lemma 4.11. 
Hint: Use Proposition 4-9. 

212 



"Distributed Control of Robotic Networks" by F. Bullo, J. Cortes and S. Martinez 
Copyright © 2006-2009. Manuscript under contract. This version: March 22, 2009 



DCRN March 22, 2009 



E4.3 (Enforcing range-limited links is unnecessary for the crcmcntr law on 

R). Let V = {pi, . . . ,p n } G F(R). For r £ R>o, we work with the r-disk proximity 
graph Gdiak(i~) evaluated at V. Let i € {1, . . . , n} and consider the circumcenter 
of the set comprised of pi and of its neighbors: 

(p g a.l)i = CC({ Pi }UM Sdiek(r) , pi (V)). 

Show that the following hold: 

(i) if pi and p., are neighbors in Qdiek{i"), then (p g0 ai)i belongs to B( ' 2 j , §); 

(ii) if pi and pj are neighbors in Gdiek{r) and pi < pj, then (p g0 ai)i < (Pgoai)j; 
and 
Finally, discuss the implication of (i) and (ii) in the execution of the CRCMCNTR 
law on the 1-dimensional space R. 

Hint: Express (p goa i)i as a function of the position of the leftmost and rightmost 
points among the neighbors ofp,. 

E4.4 (Enforcing range-limited links is unnecessary for the pll-crcmcntr law). 

Let V = {pi,...,p„} G F(R ci ) and r 6 R >0 . For k £ {l,...,d}, denote by 
7Tfc : R ci — > R the projection onto the feth component. Do the following tasks: 

(i) Show that pi and Pj are neighbors in Soo-diskM if and only if, for all 
k £ {1, . . . , d}, Tik(pi) and ^k{pj) are neighbors in 5disk(^)- 

(ii) For S C M d , justify that the parallel circumcenter PCC(S) G R d of S can 
be described as 

7r fc (PCC(5)) = CC(7r fe (S)), for k e {1, . . . , d}. 

(iii) Use (i), (ii), and Exercise E4.3(i) to justify that no constraint is required 
to maintain connectivity of the co-disk graph in the pll-crcmcntr law. 
In other words, show that if pi and pj are neighbors in the proxim- 
ity graph Goo-disk(r), then also the points PCC{{pi} U Af good . sk ( rhPi (V)) 
and PCC({pj} U Mg^ disk (r), P (J } )) are neighbors in the proximity graph 
Qoc-d\sk{r). 

E4.5 (Finite-time convergence of the crcmcntr law on Sdisk). For Umax,? - G M>o, 
let a = min{it max , |}. Let V = {pi, . . . ,p n } G F(R d ), and assume that there exists 
p G R d such that 

{pi,...,p„} C B(p,a). 

Do the following tasks: 

(i) Show that Qdisk(r) evaluated at {pi, . . . ,p„} is the complete graph. 

(ii) Justify why ||pi — CC({pi, . . . ,p»})||2 < a, for all i G {1, . . . , n}. 

(iii) Show that CC({pi,...,p„}) G X dlsk (pi,V) nB(pi,w max ). 

(iv) What is the evolution of the pair (<Sdisk,CCcRcMoNTa) (with control magni- 
tude bounds) starting from (pi, . . . ,p n )? 

E4.6 (Variation of the crcmcntr law). Let V = {pi,...,p„} G F(R d ). For r G 
R>o, we work with the r-disk proximity graph SdiskM evaluated at P. For each 
i G {1, . . . ,n}, consider the circumcenter of the set comprised of pi and of the 
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mid-points with its neighbors: 

(Pgoal), = CC({p»}U{^±^ | Pj € jV edl . k (r>,p,(7>)}). 

Do the following: 

(i) Show that if pi and p., are neighbors in Qdiak(r), then (p goa i)i and (p g0 ai)j 
are neighbors in Qdiak(r). 

(ii) Use (i) to design a control and communication law on the network Sdisk 
in R d that, while not enforcing any connectivity constraints, preserves all 
neighboring relationships in Gdisk{r) and achieves the e-rendezvous task 

-'e-rndzvs • 

(iii) Justify why the law designed in (ii) does not achieve the exact rendezvous 

taSK irndzvs- 

E4.7 (Asymptotics of the lower bound in Theorem 4.17(ii)). Show that, as 

n — > +00, 

log( £ -^) log(5V2) = n^ n) log{5V - 2))+0{iy 

— log (COS(^-)J 71"" 

Use this fact to complete the proof of the lower bound in the proof of Theo- 
rem 4.17(ii). 
Hint: Use the Taylor series expansion o/log(cos(x)) at x — 0. 
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Chapter Five 

Deployment 



The aim of this chapter is to present various solutions to the deployment 
problem. The deployment objective is to optimally place a group of robots 
in an environment of interest. The approach taken here consists of identify- 
ing aggregate functions that measure the quality of deployment of a given 
network configuration and designing control and communication laws that 
optimize these measures. 

The variety of algorithms presented in the chapter stems from two causes. 
First, different solutions arise from the interplay between the spatially dis- 
tributed character of the coordination algorithms and the limited sensing 
and communication capabilities of the robotic network. As an example, dif- 
ferent solutions are feasible when agents have range-limited communication 
capabilities or when agents have omnidirectional line-of-sight visibility sen- 
sors. Second, there is no universal notion of deployment. Different scenarios 
give rise to different ways of measuring what constitutes a good deploy- 
ment. As an example, a robotic network might follow a different strategy 
depending on whether or not it has information about areas of importance 
in the environment: in the first case, by incorporating the knowledge on the 
environment; or in the second, by assuming a worst-case scenario, where 
important things can be happening precisely at the furthest-away location 
from the network configuration. 

Our exposition here follows Cortes et al. (2004, 2005), and Cortes and 
Bullo (2005). Our approach makes extensive use of the multicenter functions 
from geometric optimization introduced in Chapter 2. It is not difficult to 
synthesize continuous-time gradient ascent algorithms using the smoothness 
results presented in Section 2.3, and characterize their asymptotic conver- 
gence properties (as we ask the reader to do in Exercises E2.14 and E2.15). 
However, following the robotic network model of Chapter 3, we are interested 
in discrete-time algorithms. In general, gradient ascent algorithms imple- 
mented in discrete time require the selection of appropriate step sizes that 
guarantee the monotonic evolution of the objective function. This is usually 
accomplished via line search procedures, (see e.g., Bertsekas and Tsitsiklis, 
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1997). In this chapter, we show that the special geometric properties of the 
multicenter functions and their gradients allow us to identify natural target 
locations for the robotic agents without the need to perform any line search. 

The chapter is organized as follows. In the first section, we formally de- 
fine the notions of deployment via task maps and multicenter functions. In 
the next section, we present motion coordination algorithms to achieve each 
deployment task. Specifically, we introduce control and communication laws 
based on various notions of geometric centers. We present convergence and 
complexity results for the proposed algorithms, along with simulations illus- 
trating our analysis. The third section presents various simulations of the 
proposed motion coordination algorithms. We end the chapter with three 
sections on, respectively, bibliographic notes, proofs of the results presented 
in the chapter, and exercises. Throughout the exposition, we make extensive 
use of proximity graphs, multicenter functions, and geometric optimization. 
The convergence and complexity analyses are based on the LaSalle Invari- 
ance Principle and on linear dynamical systems defined by Toeplitz matrices. 

5.1 PROBLEM STATEMENT 

Here, we introduce various notions of deployment. We assume that S = 
({1, . . . , n},lZ, -Ecmm) is a uniform robotic network, where the robots' physi- 
cal state space is a (simple convex) polytope QcR* 1 that describes an envi- 
ronment of interest. We define our notions of deployment relying upon the 
geometric optimization problems discussed in Section 2.3. Loosely speak- 
ing, we aim to deploy the robots in such a way as to optimize one of the 
multicenter functions, such as the expected-value multicenter function W e xp, 
the disk-covering multicenter function Tide, or the sphere-packing multicen- 
ter function H. sp . Indeed, these functions can be interpreted as quality-of- 
service measures for different scenarios. In order to formally define the task 
maps encoding the deployment objective, we take the following approach: 
since the optimizers of these measures are critical points, and these critical 
points are network configurations that make the gradients vanish, we define 
the task map to take the true value at these configurations. 



5.1.1 The distortion, area, and mixed distortion-area deployment tasks 

In this section, we define various notions of deployment originating from the 
expected-value multicenter function Ti exp . Recall the concepts of density 
and performance introduced in Section 2.3. Let cf) : M. d — > M>o be a density 
function on M. d with support Q. One can interpret as a function measur- 
ing the probability that some event takes place over the environment. Let 
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/ : M>o -^Ibea performance, that is, a non-increasing and piecewise dif- 
ferentiable function possibly with finite jump discontinuities. Performance 
functions describe the utility of placing a robot at a certain distance from 
a location in the environment. Here, we will restrict our attention to the 
cases f(x) = —x 2 (distortion problem), f(x) = l[ 0)a ](x), a £ M>o (area 
problem), and f(x) = —x 2 l[o,a] ( 2; ) ~~ ffl2 " ha,+oo[(. x )i with a £ K>o (mixed 
distortion-area problem) . 

For s £ M>o, we define the e-distortion deployment task 7^_di s tor-dpiy : 
Q n — > {true, false} by 

/true, if||pW-CM^W(P))|| 2 <e,iG{l,...,n}, 

-'e-distor-dplyi-' ) — \ . 

liaise, otherwise, 

where V^'(P) denotes the Voronoi cell of robot i, and CM^yl'^P)) denotes 
its centroid computed according to (j) ( see Section 2.1). In other words, 
^-distor-dply i s "true for those network configurations where each robot is 
sufficiently close to the centroid of its Voronoi cell. According to Theo- 
rem 2.16, centroidal Voronoi configurations correspond to the critical points 
of the multicenter function "Hdist- 

For r, e £ K>o, we define the e-r-area deployment task 7^_ r -area-dply : Q n — * 
{true, false} as follows: we define ^-r-area-dply(P) = true whenever 

/ n ont (q)(p(q)dq < e, ie{l,...,n}, 

11 Jvw(P)ndB(pm,z) 2 

and we define ^-r-area-dply(-P) = true otherwise. Here, the symbol n out 
denotes the outward normal vector to P(pW, |). In other words, ^_ r -area-dpiy 
is true for those network configurations where each agent is sufficiently close 
to a local maximum for the area of its ^-limited Voronoi cell Vl (P) = 

V^{P)C\B{p^,D at fixed V®(P). According to Theorem 2.16, the §- 
limited area-centered Voronoi configurations correspond to the critical points 
of the multicenter function W area , - • 

Finally, for r, e £ M>o, we define the e-r- distortion- area deployment task 
^-r-distor-area-dply : Q n — > {true, false} by 

* e-r-distor-area-dply \* ) 

_ ( true, if ||pW - CM^vf (P)))|| 2 < e, i £ {1, . . . ,n}, 
^ false, otherwise. 

In other words, ^- r -distor-area-dply is true for those network configurations 
where each robot is sufficiently close to the centroid of its |-limited Voronoi 
cell. According to Theorem 2.16, ^-limited centroidal Voronoi configurations 
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are the critical points of the multicenter function Tidist- 



5.1.2 The disk-covering and sphere-packing deployment tasks 

Here, we provide two additional notions of deployment based on the multi- 
center functions TL& C and TC sp , respectively. 

For e g K>o, the e- disk- covering deployment task 7^-dc-dpiy : Q n — > 
{true, false} is defined as 

[true, if||pW-CC(7W(P))|| 2 <e J t€{l,...,n}, 
[false, otherwise, 

where CC(V^'(P)) denotes the circumcenter of the Voronoi cell of robot i. 
In other words, ^-dc-dply is true for those network configurations where each 
robot is sufficiently close to the circumcenter of its Voronoi cell. Accord- 
ing to Section 2.3.2, circumcenter Voronoi configurations are, under certain 
technical conditions, critical points of the multicenter function 7{& c . 

For s G K>0j the e- sphere-packing deployment task Z=:-sp-dpiy : Q n —> 
{true, false} is defined as 

% [true, if diBt 2 (pW,IC(yW(P)))<e, t€{l,...,n}, 

[false, otherwise, 

where IC(V"W(P)) denotes the incenter set of the Voronoi cell of robot i. In 
other words, "7^-sp-dply is true for those network configurations where each 
robot is sufficiently close to the incenter set of its Voronoi cell. According 
to Section 2.3.3, incenter Voronoi configurations are, under certain technical 
conditions, critical points of the multicenter function Ti sp . 

5.2 DEPLOYMENT ALGORITHMS 

In this section, we present algorithms that can be used by a robotic network 
to achieve the various notions of deployment introduced in the previous 
section. Throughout the discussion, we use the uniform networks 5d and 
5ld °f locally connected first-order agents with the Delaunay and r-limited 
Delaunay communication, respectively, introduced in Example 3.4, and the 
uniform network 5 ve hicles of planar vehicle robots with Delaunay commu- 
nication introduced in Example 3.5. The networks 5d and <Sld evolve in 
a polytope Q C M. d , while the network 5 V ehicies evolves in a convex poly- 
gon Q CK 2 . For all the laws presented in this chapter, we assume that no 
two agents are initially at the same position, i.e., we assume that the initial 
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network configuration always belongs to Q n \ <S co ino where n denotes the 
number of robots. 

All the laws presented in this chapter share a similar structure, which we 
loosely describe as follows: 

[Informal description] In each communication round, each agent 
performs the following tasks: (i) it transmits its position and 
receives its neighbors' positions; (ii) it computes a notion of the 
geometric center of its own cell, determined according to some 
notion of partition of the environment. Between communication 
rounds, each robot moves toward this center. 



The notions of geometric center and of partition of the environment are 
different for each algorithm, and specifically tailored to the deployment task 
at hand. Let us examine them for each case. 



5.2.1 Geometric-center laws 

We present control and communication laws defined on the network Sd . All 
the laws share in common the use of the notion of Voronoi partition of the 
environment Q. We first introduce the Vrn-cntrd law, which makes use of 
the notion of the centroid of a Voronoi cell. We then propose two sets of vari- 
ations to this law. On the one hand, we present the Vrn-cntrd-dynmcs 
law, which implements the same centroid strategy on a network of pla- 
nar vehicles. On the other hand, we introduce the Vrn-CRCMCNTR and 
Vrn-ncntr laws, which instead make use of the notions of the circumcen- 
ter and incenter of a Voronoi cell, respectively. 



5.2.1.1 Voronoi-centroid control and communication law 

Here, we define the Vrn-cntrd control and communication law for the 
network 5d, which we denote by CC vrn-cntrd- This law was introduced 
by Cortes et al. (2004). We formulate the algorithm using the description 
model of Chapter 3. The law 1 is uniform, static, and data-sampled, with 



1 From Definition 3.9 and Remark 3.11 recall that a control and coordination law (1) is uniform 
if processor state set. message-generation, state-transition and control functions are the same for 
each agent; (2) is static if the processor state set is a singleton, i.e., the law requires no memory; 
(3) is data-sampled if if the control functions are independent of the current position of the robot 
and depend only upon the robots position at the last sample time. 

219 



"Distributed Control of Robotic Networks" by F. Bullo, J. Cortes and S. Martinez 
Copyright © 2006-2009. Manuscript under contract. This version: March 22, 2009 



DCRN March 22, 2009 



standard message-generation function: 



Robotic Network: 5d with discrete-time motion model (4.1.1) 
in Q, with absolute sensing of own position 

Distributed Algorithm: Vrn-CNTRD 
Alphabet: A = M d U{null} 

function msg(p, i) 
l: return p 

function ctl(p, y) 

i: V := Q n (fll-fWcvd I for a11 non-null p rcvd 6 y}) 
2: return CM^(F) — p 

Recall that H p>x is the half-space of points q in R d with the property that 
\\q— p|b < \\q— x\\2- Since the centroid of a Voronoi cell belongs to the interior 
of the cell itself, if the robots are at distinct locations at any one time, then 
they are at distinct locations after one step. Therefore, the set Q n \ <S CO mc 
is positively invariant with respect to the control and communication law 
CC vrn-cntrd- Moreover, note that the direction of motion specified by the 
control function ctl coincides with the gradient of the distortion multicenter 
function Ttdist- Hence, this law prescribes a gradient ascent strategy for each 
robot that, as we will show later, monotonically optimizes Wdist- 



5.2.1.2 Voronoi-centroid law on planar vehicles 

Next, we provide an interesting variation of the Vrn-cntrd law defined 
on the network 5 ve hi c ies- Accordingly, we adopt the continuous-time motion 
model for the unicycle vehicle: 

pW(t) = v [i] {t) (cos(# [ %)), sin(0 [i] (£))), 

9^{t)=ujM{t), ie{l,...,n}, (5.2.1) 

where we assume that forward and angular velocities are upper bounded. 
We refer to this control and communication law as the Vrn-cntrd-dynmcs 
law, and we denote it by CC Vrn-cntrd-dynmcs- The law was introduced 
by Cortes et al. (2004) and is uniform and static, but not data-sampled: 

Robotic Network: 5 V ehicles with motion model (5.2.1) in Q, 
with absolute sensing of own position 

Distributed Algorithm: Vrn-CNTRD-DYNMCS 
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Alphabet: 



U{imll} 



function msg((p, 9), i) 
l: return p 

function ctl((p, 9), (p smp i d , #sm P ld), y) 
i: F:=Qn (n{#p s ,»pid,p,cvd I for a11 non-null p rcvd 6 y}) 



, p \(co S 9,sm9)-(p-CM^V))\ 

arrtaT1 (-sing, cos 6)-(p-CM (j) (V)) 
prop arctan ^^ ^^ - g _ cM^Fj] 

4: return (u, o>) 



2: v := k 
3: w := 2k 



This algorithm is illustrated in Figure 5.1. 




Figure 5.1 An illustration of the execution of Vrn-CNTRD-dynmcs. Each row of plots 
represents an iteration of the law. In each round, each agent first computes its 
Voronoi cell, then determines the centroid, and then moves towards it. 



In the above description, we require the feedback gain k pTop to belong 



to the interval 10, 



This guarantees that the controls v,ui in 
1,1], and are therefore, 



max{7r,diam(Q)} 

the definition of ctl belong to the closed interval 

implement able in the unicycle and the differential drive robot models 



The definition of the control function ctl is based on the stabilizing feed- 
back law of Astolfi (1999). When following this control law, the robot posi- 
tion p is guaranteed to monotonically approach the target position CM^(V). 
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Unfortunately, it is a only conjecture that this controller (or an appropri- 
ately modified controller) does not lead two agents to the same positions 
(indeed, it is possible that an agent move outside its Voronoi cell). Under 
this conjecture, the Vrn-cntrd-dynmcs law enjoys the same convergence 
guarantees as the Vrn-cntrd law, that are described in Theorem 5.5. 

Remark 5.1 (Vehicles with general dynamics). The general idea of 
moving towards the centroid of a robot's Voronoi region can be implemented 
over a network of vehicles with arbitrary dynamics, as long as these vehicles 
are capable of strictly decreasing the distance to any specified position in Q 
in the time intervals between communication rounds while remaining inside 
their Voronoi cells. • 



5.2.1.3 Voronoi-circumcenter control and communication law 

Here, we define the Vrn-CRCMCNTR control and communication law for the 
network <Sd, which we denote by CC vrn-crcmcntr- This law was introduced 
by Cortes and Bullo (2005). The law is uniform, static, and data-sampled, 
with standard message-generation function: 

Robotic Network: 5d with discrete-time motion model (4.1.1) 
in Q, with absolute sensing of own position 

Distributed Algorithm: Vrn-CRCMCNTR 
Alphabet: A = M d U{null} 

function msg(p, i) 
l: return p 

function ctl(p,y) 

l: V := Q n ( D{- H p,Prcvd I for a11 non-null p rcvd G y}) 
2: return CC(V) — p 

Note that the circumcenter of a Voronoi cell belongs to the cell itself 
and therefore, robots evolving under the control and communication law 
CC vrn-crcmcntr never leave the set Q. However, in general the set Q n \S co i nc 
is not positively invariant, see Exercise E5.1. From a geometric perspective, 
this law makes sense as a strategy to optimize the disk-covering multicenter 
function Tide- From Section 2.1.3, for fixed V, the circumcenter location 
minimizes the cost given by the maximum distance to all points in V. From 
Section 2.3.2, 7i& c can be expressed (2.3.12) as the maximum over the net- 
work of each robot's individual cost. 
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5.2.1.4 Voronoi-incenter control and communication law 

Here, we define the Vrn-ncntr control and communication law for the 
network 5d, which we denote by CCvrn-ncntr- This law was introduced 
by Cortes and Bullo (2005). The law is uniform, static, and data-sampled, 
with standard message-generation function: 

Robotic Network: 5d with discrete-time motion model (4.1.1) 
in Q, with absolute sensing of own position 

Distributed Algorithm: Vrn-NCNTR 
Alphabet: A = R d U{null} 

function msg(p, i) 
l: return p 

function ctl(p,y) 

l: V := Q n ( fll-fWcvd I for a11 non-null p rcvd £ y}) 
2: return x E IC(V) — p 

Since the incenter set of a Voronoi cell belongs to the interior of the cell 
itself, if the robots are at distinct locations at any one time, then they are 
at distinct locations after one step. That is, the set Q n \ 5 C oinc is positively 
invariant with respect to the control and communication law CCvrn-ncntr- 
From a geometric perspective, this law makes sense as a strategy for op- 
timizing the sphere-packing multicenter function 7i sv . From Section 2.1.3, 
for fixed V, the incenter locations maximize the cost given by the mini- 
mum distance to the boundary of V. From Section 2.3.3, Ti sp can be ex- 
pressed (2.3.15) as the minimum over the network of each robot's individual 
cost. 

Remark 5.2 ("Move-toward-furthest-vertex" and "away-from-clos- 
est-neighbor" coordination algorithms). Consider the coordination al- 
gorithm where, at each time step, each robot moves towards the furthest- 
away vertex of its own Voronoi cell. Alternatively, consider the coordina- 
tion algorithm where, at each time step, each robot moves away from its 
closest neighbor. Both coordination algorithms define maps which depend 
discontinuously on the robots' positions. Cortes and Bullo (2005) study 
the asymptotic behavior of these laws, and show that the "move-toward- 
furthest-vertex" algorithm monotonically optimizes the multicenter function 
Tide, while the "away-from-closest-neighbor" algorithm monotonically opti- 
mizes the multicenter function Ti sp . • 
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5.2.2 Geometric-center laws with range-limited interactions 

In the following, we present two control and communication laws on the 
network 5ld- Both laws prescribe a geometric centering strategy for each 
robot and accomplish specific forms of expected-value optimization. The 
Lmtd-Vrn-nrml law optimizes the area multicenter function "Harea,- ; while 
the Lmtd-Vrn-cntrd law optimizes the mixed distortion-area multicenter 

function Hdist-area, J- 



5.2.2.1 Limited-Voronoi-normal control and communication law 

Here, we define the Lmtd-Vrn-nrml control and communication law for 
the network 5ld- This law was introduced by Cortes et al. (2005). The 
Lmtd-Vrn-nrml law, which we denote by CClmtd-Vrn-nrml, uses the notion 
of ^-limited Voronoi partition inside Q. The law is uniform, static, and data- 
sampled, with standard message-generation function: 

Robotic Network: 5ld with discrete-time motion model (4.1.1) 
with absolute sensing of own position, and 
with communication range r, in Q 

Distributed Algorithm: Lmtd-Vrn-nrml 
Alphabet: A = M d U{null} 

function msg(p, i) 
l: return p 

function ctl(p, y) 
i: V := Q n (fll-fWcvd I for a11 non-null p rcvd G y}) 



2: v := / n ont {q)(f>(q)dq 

ivndB( P ^) 



3: A* := max < X I 5 i— > / 4>(q)dq is strictly increasing on [0, A] > 

*■ JvnB(v+Sv.^) > 



4: return A*w 



IVnB(p+6v,!-) 



In the above algorithm, n out denotes the outward normal vector to B(p, £). 
Note that the direction of motion v specified by the control function ctl co- 
incides with the gradient of the multicenter function W a rea.-- The parame- 
ter A* corresponds to performing a line search procedure along the direction 
of the vector v. 
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The control function has the property that the point p + ctl(p, y) is guar- 
anteed to be in the interior of V . This can be justified by noting that for 
fixed V, the gradient of the function p — > Jy n -^/ n <j){q)dq at points in the 

boundary of V is non-vanishing and points toward the interior of V (cf. 
Exercise E2.5). As a consequence, the line search procedure terminates be- 
fore reaching the boundary of V. This discussion guarantees that the set 
Q n \ 5 co inc is positively invariant with respect to the control and communi- 
cation law CClmtd-Vrn-nrml- 



5.2.2.2 Limited-Voronoi-centroid control and communication law 

Here, we define the Lmtd-Vrn-cntrd control and communication law for 
the network 5ld- This law was introduced by Cortes et al. (2005). The 
Lmtd-Vrn-cntrd law, which we denote by CClmtd-Vrn-cntrd, uses the no- 
tion of |-limited Voronoi partition inside Q and of centroid of the individual 
|-limited Voronoi cells. The law is uniform, static, and data-sampled, with 
standard message-generation function: 

Robotic Network: 5ld with discrete-time motion model (4.1.1) 
with absolute sensing of own position, and 
with communication range r, in Q 

Distributed Algorithm: Lmtd-Vrn-CNTRD 
Alphabet: A = M d U{null} 

function msg(p, i) 
l: return p 

function ctl(p, y) 
i: V :=Qn B(p, §) n ( r\{Hp, Ptovd | for all non-null p TCvd £ y}) 
2: return CM^(F) — p 

The centroid of a ^-limited Voronoi cell belongs to the interior of the cell 
itself, and this fact guarantees that the set Q n \ 5 co i nc is positively invariant 
with respect to the control and communication law CClmtd-Vrn-cntrd • More- 
over, note that the direction of motion specified by the control function ctl 
coincides with the gradient of the multicenter function "Hdist-area, - • 

Remark 5.3 (Relative sensing version). It is possible to implement the 
limited- Voronoi-normal and limited- Voronoi-centroid laws as static relative- 
sensing control laws on the relative-sensing network 5^- sk . This is a conse- 
quence of the fact that the r-limited Delaunay graph is spatially distributed 
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over the r-disk graph (cf., Theorem 2.7(iii)). Let us present one of these 
examples for completeness: 

Relative Sensing Network: S™ isk with motion model (4.1.2) 
in Q, no communication, relative sensing for robot i given by: 
robot measurements y contains pf £ B(0 2 , r) for all j ^ i 
environment measurement is y env = (Q £ )i nB(0d,r) 

Distributed Algorithm: RELATIVE-SENSING Lmtd-Vrn-CNTRD 

function ctl(y, y env ) 

l: V : = y env fl B(0 d , §) n ( f\{H 0iiPimad I for all non-null p snsd £ y}) 
2: return CM </) (F) 

Note that only the positions of neighboring robots in the r-limited Delau- 
nay graph have an effect on the computation of the set V. • 

Remark 5.4 (Range-limited version of Vrn-cntrd). The Lmtd-Vrn- 
nrml and Lmtd-Vrn-cntrd laws can be combined into a single control 
and communication law to synthesize an algorithm that monotonically op- 
timizes the function 7Ydist-area,-,&; with b = — diam(Q) 2 . This law, which we 
term Rng-Vrn-cntrd, is uniform, static, and data-sampled, with standard 
message-generation function: 

Robotic Network: 5ld with discrete-time motion model (4.1.1) 
in Q, with absolute sensing of own position, and 
with communication range r 

Distributed Algorithm: Rng-Vrn-CNTRD 
Alphabet: A = M d U{null} 

function msg(p, i) 
l: return p 

function ctl(p, y) 

l: V := Q(l (f]{-fWcvd I for a11 non-null p rcvd £ y}) 
2: v x := 2 A^V n B(p, §))(CM^(V n B(p, I)) - p) 

3: v 2 := (diam(Q) 2 - x) / n ont (q)4>(q)dq 

JVr\dB(p,^) 

4: A* := max | A| 5 h-> Hy{p + 5(v\ + v 2 ),B(p + 5{v\ +v 2 ), -)) 

is strictly increasing on (0, A) > 
5: return A*(ui + v 2 ) 
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In the above algorithm, n ou t denotes the outward normal vector to B(p, |) 
and, for a point p £ V and a closed ball B centered at a point in V with 
radius g, Hy is defined as 

ftv(p,B) = - / _lk-p||i^(e)^- diam(Q) 2 / _ <j)(q)dq. 

JvnB Jvn(Q\B) 

The Rng-Vrn-cntrd law is relevant because of the following discus- 
sion. Recall from Proposition 2.17 that the general mixed distortion-area 
multicenter function can be used to provide constant-factor approximations 
of the distortion function 7Ydist- As we discussed in Section 2.3.1, robots 
with range-limited interactions cannot implement Vrn-cntrd because, for 
a given r £ K>o, Qt> is not in general spatially distributed over t/ disk (r) 
(cf., Remark 2.10). However, robotic agents with range-limited interactions 
can implement the computations involved in Lmtd-Vrn-nrml and Lmtd- 
Vrn-cntrd, and hence can optimize Hdist-area,£,6j with b = — diamQ 2 . 
Assuming r < 2diam(Q), it is fair to say that the above algorithm can be 
understood as a range-limited version of the Vrn-cntrd law. • 



5.2.3 Correctness and complexity of geometric-center laws 

In this section, we characterize the convergence and complexity properties 
of the geometric-center laws. The asynchronous execution of the Voronoi- 
centroid control and communication law can be studied as an asynchronous 
gradient dynamical system (see Cortes et al., 2004). 

The following theorem summarizes the results known in the literature 
about the asymptotic properties of these laws. 

Theorem 5.5 (Correctness of the geometric-center algorithms). 

For d £ N, r 6 K>o, and e £ R>o> the following statements hold for any 
execution that starts from an configuration in Q n \5 co i nc : 

(i) On the network S-q, the law CCvrn-cntrd achieves the e-distortion 
deployment task ^-distor-dply Moreover, any execution of the law 
CC vrn-cntrd monotonically optimizes the multicenter function Ti^ist- 

(ii) On the network Sd, any execution of the law CCvrn-cromcntr mono- 
tonically optimizes the multicenter function Tide- 

(Hi) On the network Sd, any execution of the law CCvrn-ncntr monoton- 
ically optimizes the multicenter function TC sp . 
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(iv) On the network 5ld , the law CClmtd-Vrn-nrml achieves the e-r-area 
deployment task ^-r-area-dply Moreover, any execution of the law 
CClmtd-Vrn-nrml monotonically optimizes the multicenter function 

(v) On the network <Sld, the law CC lmtd-Vrn-cntrd achieves the e-r- 
distortion-area deployment task ^-r-distor-area-dpiy Moreover, any 
execution of CClmtd-Vrn-cntrd monotonically optimizes the multi- 
center function Wdist-area, r - ■ 

The proof of this theorem is given in Section 5.5.1. The results on 
CCvrn-cntrd appeared originally in Cortes et al. (2004). Note that an exe- 
cution of CC vrn-cntrd can be viewed as an alternating sequence of config- 
uration of points and partitions of the space, with the properties that (i) 
each configuration of points corresponds to the set of centroid locations of 
the immediately preceding partition in the sequence, and (ii) each partition 
corresponds to the Voronoi partition determined by the immediately pre- 
ceding configuration of points in the sequence. The monotonic behavior of 
7^dist now follows from Propositions 2.13 and 2.14. Similar interpretations 
can be given to all other laws. In particular, the monotonic behavior of Tide 
along executions of CC Vrn-crcmcntr can be established via Proposition 2.19, 
and the monotonic behavior of TC sp along executions of CC vrn-ncntr can be 
established via Proposition 2.21. Continuous-time versions of these laws are 
studied by Cortes and Bullo (2005) via nonsmooth stability analysis, where 
the following convergence properties are established (recall the notion of 
active and passive nodes introduced in Sections 2.3.2 and 2.3.3): all ac- 
tive agents are guaranteed to asymptotically reach the circumcenter (resp., 
incenter) of their Voronoi region, whereas it is not known if the same con- 
clusion holds for the passive agents. Depending on the polytope Q, there 
exist circumcenter and incenter Voronoi configurations where not all agents 
are active, and simulations show that in some cases the continuous-time 
versions of CC Vrn-crcmcntr and CC vrn-ncntr converge to them. It is an open 
research question to show that CC Vrn-crcmcntr and CC vrn-ncntr achieve the 
e- disk- covering deployment task 7^_d c -dpiy and the e-sphere-packing deploy- 
ment task 7^-sp-dpiy, respectively. Finally, the results on CClmtd-Vrn-nrml 
and CC lmtd-Vrn-cntrd appeared in Cortes et al. (2005). 

Next, we analyze the time complexity of CClmtd- Vrn-cntrd- We provide 
complete results only for the case d = 1 and uniform density. We assume 
that diam(Q) is independent of n, r, and e. 

Theorem 5.6 (Time complexity of Lmtd-Vrn-cntrd law). Assume 
that the robots evolve in a closed interval QcM, that is, d = 1, and assume 
that the density is uniform, that is, <p = 1. For r 6 M>o and e 6 K>o> on the 
network S L u, TC(7^. r . d i s tor-area-dply,CC L MTD- Vrn-cntrd) G 0(n 3 log(ne -1 )). 
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The proof of this result is given in Section 5.5.2 following the treatment 
in Martinez et al. (2007b). 

Remark 5.7 (Congestion effects). Interestingly, Theorem 5.6 also holds 
if, motivated by wireless congestion considerations, we take the communi- 
cation range r to be a monotone non-increasing function r : N — > ]0, 27r[ of 
the number of robotic agents n. • 

5.3 SIMULATION RESULTS 

In this section, we illustrate the execution of the various control and com- 
munication laws introduced in this chapter. 



Geometric-center algorithms for expected-value optimization 

The Vrn-cntrd, Lmtd-Vrn-nrml, and Lmtd-Vrn-cntrd control and 
communication laws are implemented in Mathematica® as a library of rou- 
tines and a main program running the simulation. The objective of a first 
routine is to compute the | -limited Voronoi partition and parameterize each 
cell Vi.z, i € {1, . . . , n} in polar coordinates. The objective of a second rou- 
tine is to compute the surface integrals on these sets and the line integrals 
on their boundaries via the numerical integration routine NIntegrate. We 
pay careful attention to numerical accuracy issues in the computation of the 
Voronoi diagram and in the integration. 

Measuring displacements in meters, we consider the polygon Q determined 
by the vertices 

{(0,0), (2.125,0), (2.9325, 1.5), (2.975, 1.6), 

(2.9325, 1.7), (2.295, 2.1), (0.85, 2.3), (0.17, 1.2)}. 

The diameter of Q is diam(Q) ~ 3.378. In all figures, the density function <fi 
is the sum of four Gaussian functions of the form 11 exp(6(— (x — x cen ter) 2 — 
(y — ^center) 2 )) and is represented by means of its contour plot. Darker- 
colored areas correspond to higher values of the density function. The four 
centers (^center Reenter) of the Gaussian functions are the points (2.15,0.75), 
(1.0,0.25), (0.725, 1.75) and (0.25, 0.7), respectively. The area of the polygon 
is A^(Q) = 17.6352. 

We show evolutions of (<Sd, Vrn-cntrd) and (<Sd, Vrn-cntrd-dynmcs) 
in Figures 5.2 and 5.3, respectively. One can verify that the final network 
configurations is a centroidal Voronoi configuration. In other words, the 
task 7^_distor-dpi y is achieved, as guaranteed by Theorem 5.5(i) for the Vrn- 
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CNTRD algorithm. For each evolution we depict the initial positions, the 
trajectories, and the final positions of all robots. 




Figure 5.2 The evolution of (Sd, Vrn-CNTRd) with n — 20 robots. The left-hand (resp., 
right-hand) figure illustrates the initial (resp., final) locations and Voronoi par- 
tition. The central figure illustrates the evolution of the robots. After 13 sec- 
onds, the value of Hdist has monotonically increased to approximately —0.515. 



£** 



mmi^-t 







Figure 5.3 The evolution of (S D , Vrn-CNTRD-dynmcs) with n — 20 robots and with feed- 



back gain fc p 



3.5. The left-hand (resp., right-hand) figure illustrates the 



initial (resp., final) locations and Voronoi partition. The central figure illus- 
trates the evolution of the robots. After 20 seconds, the value of Tid\ s t has 
monotonically increased to approximately —0.555. 

We show an evolution of (5ld, Lmtd-Vrn-nrml) in Figure 5.4. One 
can verify that the final network configuration is an ^-limited area-centered 
Voronoi configuration. In other words, the task 2^-r-area-dply is achieved, as 
guaranteed by Theorem 5.5(h). 




Figure 5.4 The evolution of (Sld, Lmtd-Vrn-nrml) with n — 20 robots and r — 0.4. The 
left-hand (resp., right-hand) figure illustrates the initial (respectively, final) 
locations and Voronoi partition. The central figure illustrates the evolution 
of the robots. The ^-limited Voronoi cell of each robot is plotted in light 
gray. After 36 seconds, the value of 7i areai r has monotonically increased to 
approximately 14.141. 
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We show an evolution of (5ld 5 Lmtd-Vrn-cntrd) in Figure 5.5. One can 
verify that the final network configuration is a ^-limited centroidal Voronoi 
configuration. In other words, the task 7^_ r _distor-area-dpi y is achieved, as 
guaranteed by Theorem 5.5(iii). 




Figure 5.5 The evolution of (Sld, Lmtd-Vrn-cntrd) with n = 20 robots and r — 0.4. 
The left-hand (resp., right-hand) figure illustrates the initial (resp., final) lo- 
cations and Voronoi partition. The central figure illustrates the evolution of 
the robots. The |-limited Voronoi cell of each robot is plotted in light gray. 



After 90 seconds, the value of Hd 



s r reaches approximately —0.386. 



We show an evolution of (5lDj Rng-Vrn-cntrd) in Figure 5.6. One can 
verify that the final network configuration corresponds to a critical point 
of the mixed distortion-area multicenter function Waist-area, £ , 6) with b = 
-diam(Q) 2 , (see Exercise E5.4). 




Figure 5.6 The evolution of (Sld, Rng-Vrn-cntrd) with n — 20 robots and r = 0.47. 
The left-hand (resp., right-hand) figure illustrates the initial (respectively, fi- 
nal) locations and Voronoi partition. The central figure illustrates the evolu- 
tion of the robots. The ^-limited Voronoi cell of each robot is plotted in light 



gray. After 13 seconds, the value of W<ji S t-area, I 
approximately —4.794. 



with b 



diam(Q) 



As discussed in Remark 5.4, Rng-Vrn-cntrd can be understood as a 
range-limited implementation of Vrn-CNTRD in a network of robots with 
range-limited interactions. Let us briefly compare the evolutions depicted 
in Figures 5.2 and 5.6. According to Proposition 2.17, we compute 







diamQ 



0.06957. 



231 



"Distributed Control of Robotic Networks" by F. Bullo, J. Cortes and S. Martinez 
Copyright © 2006-2009. Manuscript under contract. This version: March 22, 2009 



DCRN March 22, 2009 



From the constant-factor approximation (2.3.7), the absolute error is guar- 
anteed to be less than or equal to (/3 2 — l)?idist-area,^,6(-Pfinai) ~ 4.77, where 
-Pfinai denotes the final configuration in Figure 5.6. The percentage error in 
the value of the multicenter function Ttdist between the final configuration 
of the evolution in Figure 5.2 and the final configuration of the evolution in 
Figure 5.6 is approximately equal to 3.277%. As expected, one can verify in 
simulations that the percentage error of the performance of the range-limited 
implementation improves with higher values of the ratio dia ^ q . 



Geometric-center algorithms for disk-covering and sphere-packing 



The Vrn-CRCMCNTR and Vrn-ncntr control and communication laws are 
implemented in Mathematica® as a single centralized program running the 
simulation. We compute the bounded Voronoi diagram of a collection of 
points using the package ComputationalGeometry. We compute the cir- 
cumcenter of a polygon via the algorithm in Skyum (1991) and the incenter 
set via the LinearProgramming solver in Mathematica®. 



Measuring displacements in meters, we consider the polygon determined 
by the vertices 

{(0,0), (2.5,0), (3.45, 1.5), (3.5, 1.6), 

(3.45, 1.7), (2.7, 2.1), (1.0, 2.4), (0.2, 1.2)}. 

We show an evolution of (5d, Vrn-CRCMCNTr) in Figure 5.7. One can 
verify that in the final configuration all robots are at the circumcenter of 
their own Voronoi cell. In other words, the task Zj-dc-dpiy is achieved by this 
evolution. As stated in Section 5.2.3, it is an open research question to show 
that this fact holds in general for CCvrn-crcmcntr- Cortes and Bullo (2005) 
prove a similar result for a continuous-time implementation of this law. 




Figure 5.7 The evolution of (So , Vrn-CRCMCNTr) with n = 16 robots. The left-hand 
(resp., right-hand) figure illustrates the initial (resp., final) locations and 
Voronoi partition. The central figure illustrates the evolution of the robots. Af- 
ter 20 seconds, the value of Tide has monotonically decreased to approximately 
0.43273 meters. 
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We show an evolution of (<Sd, Vrn-ncntr) in Figure 5.8. One can verify 
that in the final configuration all robots are at the incenter of their own 
Voronoi cell. In other words, the task 7^-sp-dpiy is achieved by this evolution. 
As stated in Section 5.2.3, it is an open research question to show that this 
fact holds in general for CCvrn-ncntr- Cortes and Bullo (2005) prove a similar 
result for a continuous-time implementation of this law. 




Figure 5.8 The evolution of (5d, Vrn-ncntr) with n — 16 robots. The left-hand (resp., 
right-hand) figure illustrates the initial (resp., final) locations and Voronoi 
partition. The central figure illustrates the evolution of the robots. After 20 
seconds, the value of TC sp has monotonically increased to approximately 0.2498 
meters. 



5.4 NOTES 

The deployment problem studied in this chapter is related to the literature 
on facility location (Drezner, 1995; Okabe et al., 2000; Du et al., 1999) and 
geometric optimization (Agarwal and Sharir, 1998; Boltyanski et al., 1999) 
(see also Section 2.4). These disciplines study spatial resource allocation 
problems and play an important role in quantization theory, mesh and grid 
optimization methods, clustering analysis, data compression, and statistical 
pattern recognition. 

Dispersion laws have been traditionally studied in behavior control (see, 
e.g., (Arkin, 1998; Schultz and Parker, 2002; Balch and Parker, 2002)). De- 
ployment algorithms that make use of potential field methods are proposed 
by Payton et al. (2001) and Howard et al. (2002). Other works include 
(Bulusu et al., 2001) on adaptive beacon placement for localization, Poduri 
and Sukhatme (2004) on network deployments that satisfy a pre-specified 
constraint in the number of neighbors of each robot, Arsie et al. (2009) on 
sensor-based deployment strategies that minimize the expected service time 
for newly appearing target points, and Hussein and Stipanovic (2007) on 
dynamically surveying a known environment. 

Deployment algorithms for coverage control are a subject of active re- 
search. Among the most recent works, Martinez (2009a) and Schwager 
et al. (2009) consider coverage problems where the density function is un- 
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known, Lekien and Leonard (2009) propose centralized laws for non-uniform 
coverage using cartograms, de Silva and Ghrist (2007) study static coverage 
problems with minimal assumptions on the capabilities of individual sensors 
using algebraic topology, Kwok and Martinez (2009) propose distributed de- 
ployment strategies for energy-constrained networks, Laventall and Cortes 
(2009) design distributed algorithms for networks of robots whose sensors 
have range-limited wedge-shaped footprints, Gao et al. (2008) consider dis- 
crete coverage problems, Schwager et al. (2008) consider joint exploration 
and deployment problems, and Zhong and Cassandras (2008), Pimenta et al. 
(2008), and Caicedo-Nunez and Zefran (2008) deal with centroidal Voronoi 
tessellations in nonconvex environments. Graham and Cortes (2009) study 
the optimality of circumcenter and incenter Voronoi configurations for the 
estimation of stochastic spatial fields. Susca et al. (2009) consider some 
planar interpolation problems. 

Deployment problems play a relevant role in other coordination tasks, 
such as surveillance, search and rescue, and exploration and map building 
of unknown environments. Choset (2001) considers sweep coverage problems, 
where one or more robots equipped with limited footprint sensors have to 
visit all points in the environment. In Simmons et al. (2000), deployment 
locations for a network of heterogeneous robots are user-specified after an 
initial map of the unknown environment has been built. Gupta et al. (2006a) 
consider a combined sensor coverage and selection problem. 

Deployment of robotic agents with visibility sensors has been studied un- 
der a variety of assumptions. When the environment is known a priori, the 
problem can be cast as the classical Art Gallery Problem (Chvatal, 1975) 
from computational geometry, where one is interested in achieving complete 
visibility with the minimum number of agents possible. The Art Gallery 
Problem is computationally hard (Lee and Lin, 1986; Eidenbenz et al., 2001) 
and the best-known approximation algorithms yield solutions within a log- 
arithmic factor of the optimum number of agents (Ghosh, 1987; Efrat and 
Har-Peled, 2006). Pinciu (2003) and Hernandez-Penalver (1994) study the 
problem of achieving full visibility while guaranteeing that the final network 
configuration will have a connected visibility graph. Recent works on multi- 
robot exploration of unknown environments include (Batalin and Sukhatme, 
2004), Burgard et al. (2005), and Howard et al. (2006). Topological explo- 
ration of graph-like environments by single and multiple robots is studied 
in Rekleitis et al. (2001), Fraigniaud et al. (2004), and Dynia et al. (2006). 
A simple one-step strategy for visibility deployment, without the need for 
synchronization, achieving the worst-case optimal bounds in terms of the 
number of robots required, and under limited communication, is presented 
in Ganguli et al. (2007). 
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5.5 PROOFS 

This section gathers the proofs of the main results presented in the chapter. 



5.5.1 Proof of Theorem 5.5 

Proof. Let P = (p [1] (0), ■ ■ • ,P W (0)) G Q n \S colnc denote the initial con- 
dition. The proof strategy for all five facts is similar and is based on the 
application of the LaSalle Invariance Principle with Lyapunov function given 
by an appropriate multicenter function. In other words, we need to estab- 
lish the monotonic behavior of the certain multicenter functions along the 
executions of the control and communication laws and we need to charac- 
terize certain invariant sets using geometric properties of the multicenter 
functions. Additionally, in order to apply the LaSalle Invariance Principle, 
we need to work with the set Q n \ iS co inc which is not closed and, therefore, 
we rely upon the extension of Theorem 1.19 given in Exercise E1.8(ii). 

In what follows, we discuss in detail the proof of fact (i) regarding the 
control and communication law CCvrn-cntrd for the network 5d- We leave 
it to the reader to fill out some of the proof details for the other laws. 

Fact (i). First, note that, starting from a configuration in Q n \ 5 co inc> 
one step of the law CCvrn-cntrd leads the network to another configuration 
in Q n \ 5 co i nc . Therefore, it is convenient to let /vrn-cntrd : Q n \ <S co inc — * 
Q n \S co i nc denote the map induced by the execution of one step of the control 
and communication law CCvrn-cntrd- 

To apply Theorem 1.19, we work with the set W = Q n \ <S CO mc- Clearly, 
this set is positively invariant for /vrn-cntrd and it is bounded. Therefore, 
assumptions (i) and (iii) of Theorem 1.19 are satisfied, except for the closed- 
ness of W. Next, we show that executions of the law CCvrn-cntrd monoton- 
ically optimize the function Tldist- Using the extension of the multicenter 
function defined over the set of points and partitions of Q, we deduce from 
Proposition 2.13 that, for P £ Q n \ 5 CO i nc , 

'Ldisti/VRN-CNTRDi-' )) = /Tdist (/Vrn-cntrd \P ) ) v (JVrn-cntrdI,-' ))) 

> Wdist(/VRN-CNTRI)(-P), V(-P)). 

The application of Proposition 2.14 yields 

Wdist (/Vrn-cntrd (P),V(P)) > n dist (P,V(P)), 

and, therefore, 7idist(/vRN-cNTRD(-P)) > Wdist(-P)- Additionally, recall from 
Proposition 2.14, that, for P £ Q n \ 5 co inc, the inequality is strict unless 
/vrn-cntrd(-P) = P- This discussion establishes assumption (ii) of Theo- 
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rem 1.19. The continuity of the map /vrn-cntrd : Q n \ S co - mc -> Q n \ S co - mc , 
is a consequence of the following two facts. First, one can verify that each 
Voronoi cell is a convex set whose boundary is a piecewise continuously dif- 
ferentiable function of the positions of the robots. Second, given a convex set 
whose boundary depends upon a parameter in a piecewise continuously dif- 
ferentiable fashion, Proposition 2.23 guarantees that the centroid of that set 
is a continuously differentiable function of the parameter. This discussion 
and the continuity of Waist establishes assumption (iv) of Theorem 1.19. 

In the following, we consider an evolution 7 : Z>o — > Q n \ 5 C oinc of 
/vrn-cntrd an( i we prove that no point in 5 co i nc may be an accumulation 
point of 7. By contradiction, we assume that P = (pi, ■ ■ ■ ,p n ) £ <Scoinc 
is an accumulation point for 7. Our first claim is that there exists a se- 
quence of increasing times {£^ | k £ N} and unit-length vectors Uij 6 R d , 
for i,j E {1, . . . , n}, such that 7(4) — * P and simultaneously vers(7i(^) — 
7j(4)) ~^ u ij as k — > 00. Here, the versor operator vers : M. d — > M. d is 
defined by vers(O^) = 0^ and vers(u) = v/IMb for v 7^ 0,^. This first 
claim is true because P is an accumulation point and because the sequences 
£ 1— > vers(7i(^) — 7j(£)) take value in a compact set. Our second claim is that, 
as k —> 00, the sequence of partitions V("f(£k)) has a limiting partition, say 
{V] 00 , . . . , V£°}. This second claim is true because, for each pair of robots i 
and j converging to the same position pi = pj , the bisector of the segment 
connecting them admits a limit that is equal to the line through the point 
Pi = pj and perpendicular to the unit-length vector uij. Therefore, each of 
the edges of each of the polygons V (7 (■£&)) has a limit for k — > 00. Finally, 
note that each polygon V°° has a positive measure. 

We know that £ 1— > "Hdistil^)) is monotonically non-increasing and lower- 
bounded. Therefore, we must have that 

lim (n dist (l(£)) - H dist (7(£ + 1))) = 0. (5.5.1) 

Define the short-hand Wk,i = ^i(7(4))> and compute 

lim (W d ist(7(4)) - Hdtat(7(4 + 1)) 

k— >oo \ 



7l(4)|||^(9)^- / \\q-CM^W Kl }\\l(t ) (q)dq) 



> lim 

(5.5.2) 
= / h-Pi\\lmdq- f \\q - CM^VnWl^dq (5.5.3) 

= k 4> {yn\\Pi-GM 4l {Vnh, (5.5.4) 

where inequality (5.5.2) follows from Proposition 2.14, equality (5.5.3) fol- 
lows from the definition of the limiting partition {Vj 00 , . . . , V£°}, and equa- 
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tion (5.5.4) follows from the Parallel Axis Theorem. Now, the quantity 
A^V] 00 ) is strictly positive, as mentioned above, and the quantity \\p\ — 
CM0(y i oo )|| 2 is strictly positive because pi £ dV£° and CM^ 00 ) belongs 
to the interior of V^° by Exercise (E2.2). The fact that the last limit is lower 
bounded by a positive is a contradiction with equation (5.5.1). Therefore, 
we now know that no point in 5 C oinc may be an accumulation point of 7. 

Finally, we are now ready to apply the LaSalle Invariance Principle as 
stated in Exercise El. 8(h) and deduce that the execution of CC vrn-cntrd 
starting from Pq £ Q n \ 5 C oinc tends to the largest positively invariant set S 
contained in 

{P G Q n I H d]st (/vrn-cntrd (P)) = H d]st (P)}. 

The set S is precisely the set of centroidal Voronoi configurations. This result 
is a consequence of the fact that Wdist(/vRN-cNTRD(P)) = ^dist(-P) implies 
that /vrn-cntrd(P) = P, that is, P is a centroidal Voronoi configuration. 

Facts (ii) and (in). The proofs of these facts run parallel to the proof of 
fact (i). Propositions 2.19 and 2.21 are key in establishing the monotonic 
evolution of "Hdc and W sp , respectively. 

Fact (iv). Let /lmtd-Vrn-nrml : Q n \ Scoinc -> Q n \ <S C omc denote the map 
induced by the execution of one step of the law CClmtd-Vrn-nrml- Let us 
show that executions of CClmtd-Vrn-nrml monotonically optimize the func- 
tion Tiarea, - • Using the extension of the multicenter function defined over 
the set of points and partitions of Q, we deduce from Proposition 2.13 that, 
forPeQ"\5 coinc , 

/larea, J ( JLmtd-Vrn-nrml(PJ) 

= /Larea,^ (JLmtd-Vrn-nrml(PJ) ' / AJLmtd-Vrn-nrml(-' ))) 
^ /Larea, M /Lmtd-Vrn-nrml (Pj) r\P))- 

The line search procedure for each robot embedded in the definition of the 
control function of CClmtd-Vrn-nrml ensures that 

Haxea,f (/lmtd-Vrn-nrml(P), V(P)) > W are a,^ (P, V(P)), 

and hence, Warea^(/LMTD-VRN-NRM L (P)) > H a rea,§(P)- Note that the in- 
equality is strict unless /lmtd-Vrn-nrml (P) = P- We leave it to the in- 
terested reader to prove, similarly to what we did for fact (i), that the map 
/lmtd-Vrn-nrml is continuous and that no point in 5 co i nc may be an accumu- 
lation point of any trajectory of Jlmtd-Vrn-nrml • Finally, the application of 
the LaSalle Invariance Principle as in the proof of fact (i) leads us to the 
result stated in fact (iv). 

Fact (v). The proof of this fact runs parallel to the proofs of facts (i) 
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and (iv). Propositions 2.13 and 2.15 are key in establishing the monotonic 
evolution of the cost function Tidist-area.^- B 



5.5.2 Proof of Theorem 5.6 

Proof. For d = 1, Q is a compact interval on R — say Q = [g_, g+]. We start 
with a brief discussion about connectivity. In the r-limited Delaunay graph, 
two agents that are at most at a distance r from each other are neighbors if 
and only if there are no other agents between them. Additionally, we claim 
that if agents i and j are neighbors, then | CM^(VW)— CM,*(V^)| < r, where 
V^ denotes the set defined by the control function ctl when evaluated by 
agent i. To show this fact, let us assume without loss of generality that 
pN < ptf\_ L e t. us consider the case where the agents have neighbors on 
both sides (the other cases can be treated analogously). Let p_ (resp., p+) 
denote the position of the neighbor of agent i to the left (resp., of agent j 
to the right). Now, 

CM tj> (y®) = ^(p®+2p®+pW), 

CM^V^) = ^(p^ + 2p^+p l l ] ), 
where we have used the fact that <f> = 1. Therefore, 

I CM^(yW) - cm^(t/^)| < -(ip 1 ! 1 - p ®\ + 2\ p ® - p W\ + \ P w - P [ i ] \) < r . 

This implies that agents i and j belong to the same connected component 
of the r-limited Delaunay graph at the next time step. 

Next, let us consider the case when t/ LD (r) is connected at the initial 
network configuration Pq = (pW(0), . . . ,p' n '(0)). Without loss of generality, 
assume that the agents are ordered from left to right according to their 
unique identifier, that is, pW(0) < ■ • • < p^ n '(0). We distinguish three cases 
depending on the proximity of the leftmost and rightmost agents 1 and n, 
respectively, to the boundary of the environment: in case (a) both agents 
are within a distance | of dQ; in case (b), neither of the two is within a 
distance | of dQ; and in case (c) only one of the agents is within a distance | 
of dQ. Here is an important observation: from one time instant to the next, 
the network configuration can fall into any of the cases described above. 
However, because of the discussion on connectivity, transitions can only 
occur from case (b) to either case (a) or case (c); and from case (c) to case 
(a). As we show below, for each of these cases, the network evolution under 
CCvrn-cntrd can be described as a discrete-time linear dynamical system 
which respects agents' ordering. 
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Let us consider case (a). In this case, we have 

pW(i + i) = l( p m(i) + 2pM(i) + pW(i)), 



>-i] 



e+i) 



](p^(l) + 2p^- 1 \t)+pW(t)), 



pW(^ + l) = I(p[»-i](^) + pN(^) + I g+ . 

Equivalently, we can write P(£ + 1) = Ar a \ ■ P(£) + b/ a \, where the matrix 
Ar a \ el" x ™ and the vector br a } G W 1 are given by 



Ha) 



i 








1 




1 

2 


1 
1 




1 




1 























1 

I 

1 


1 

I 

1 



'(a) 








.50+. 



Note that the only equilibrium network configuration P* respecting the or- 
dering of the agents is given by 

pf =q_ + ^(l + 2(i- l))(q + -q_), i G {1, . . . , n}, 
An 

and note that this is a |-centroidal Voronoi configuration (under the as- 
sumption of case (a)). We can therefore write (P(£+ 1) — P*) = Ar a \(P((.) — 
P*). Now, note that ^4 (a ) = ATrid" (|,|). Theorem 1.80(h) implies that 
lim^ +00 fP(^)— P*j = n , and that the maximum time required for ||P(£) — 
P* L — e 11-^0 ~ -f*ll2 (over all initial conditions in W 1 ) is 0(n 2 loge _1 ). It is 
not obvious, but it can be verified, that the initial condition providing the 
lower bound in the time complexity estimate does indeed have the property 
of respecting the agents' ordering; this fact holds for all three possible cases 
(a), (b), and (c). 

Case (b) can be treated in the same way. The network evolution now 
takes the form Pit + 1) = A( h ) ■ P(£) + 6(b), where the matrix A( b ) G R nXn 
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and the vector b^ £ W 1 are given by 



i(b) 
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I 1 
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1 
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I. 



5 (b) 



4' 





In this case, a (non-unique) equilibrium network configuration respecting 
the ordering of the agents is of the form 



p* 



1 + n 



ir 



i £ {!,..., n}. 



Note that this is a ^-centroidal Voronoi configuration (under the assump- 
tion of case (b)). We can therefore write (P(£ + 1) — P*) = A^(P(£) — 
P*). Now, observe that At^ = ATrid^ Q, |). We compute that P ave = 



urrPn 



p*) 



liT 



^-q ~~ -f*J = n L n r o- With this calculation, Theorem 1.80(i) implies 



liPn 



that lim^ +O0 (P(f) - P* - P ave 
quired for \\P{£) - P* - P ave l n || 2 
conditions in M n ) is 0(n 2 log£ _1 ) 



In) = n , and that the maximum time re- 
< e||Po — P* — Pavelnlb (over all initial 



Case (c) needs to be handled differently. Without loss of generality, as- 
sume that agent 1 is within distance | of dQ and agent n is not (the other 
case is treated analogously). Then, the network evolution now takes the 
form P(£ + 1) = >l( c ) • P{£) + 6( c ), where the matrix A( c ) £ R' 



and the 



vector b 



(c) 



.4 



(c) 



n are given 


by 
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5(c) 



Note that the only equilibrium network configuration P* respecting the or- 
dering of the agents is given by 

pi ] = q- + -x(2i- l)r, i £ {l,...,n}, 

and note that this is a |-centroidal Voronoi configuration (under the as- 
sumption of case (c)). In order to analyze Ar c \, we recast the n-dimensional 
discrete-time dynamical system as a 2n-dimensional one. To do this, we 
define a 2n-dimensional vector y by 



p'- 1 ', i £ {1, . . . ,n}, and y 



n+i 



Jn-i+1] 



i £{!,..., n}. (5.5.5) 



240 



"Distributed Control of Robotic Networks" by F. Bullo, J. Cortes and S. Martinez 
Copyright © 2006-2009. Manuscript under contract. This version: March 22, 2009 



DCRN March 22, 2009 



Now, one can see that the network evolution can be alternatively described 
in the variables (y'- 1 ', . . . ,y' 2n ') as a linear dynamical system determined by 
the 2n x 2n matrix A r Trid^ n (j, g)- Using Theorem 1.80(h), and exploiting 
the chain of equalities (5.5.5), it is possible to infer that, in case (c), the 
maximum time required for ||P(^) — P*\\ 2 — e ll^"b ~~ -AII2 (over all initial 
conditions in M n ) is 0(n 2 loge -1 ). 

In summary, for all three cases (a), (b), and (c), our calculations show 
that, in time 0(n 2 log e _1 ), the error 2-norm satisfies the contraction in- 
equality \\P(£) — P*\\ 2 < e 11-^*0 — P*\\2- We convert this inequality on 2- 
norms into an appropriate inequality on oo-norms as follows. Note that 
ll-Po - Alloc = maxjgj!. .„} |pH(0) - p* | < (q+ - g_). For £ of order 
n 2 log7j — , we have that 

\\P(£) - Alloc < \\P(£) - P*h < v\\Po - P*h 

< r]^/n\\P - P*||oo < r]^(q + - q-). 

This means that e-r-deployment is achieved for rj- s /n{q + — q~) = e, that is, 
in time 0(n 2 logr/ -1 ) = 0(n 2 log(ne -1 )). 

Up to here, we have proved that if the graph £ LD (r) is connected at 
P , then TC(7;_ 7 ._ dply ,CC V RN-cNTRD,-Po) £ 0(n 2 \og{ne~ 1 )). If £ld(0 is not 
connected at Pq, note that along the network evolution there can only be 
a finite number of time instants, at most n — 1 where a merging of two 
connected components occurs. Therefore, the time complexity is at most 
0(n 3 log(ne -1 )), as claimed. ■ 



5.6 EXERCISES 

E5.1 (The Vrn-crcmcntr law is not positively invariant on <5 n \5 C oinc)- Consider 
the network Sd composed by 2 robots evolving in the convex polygon depicted in 
Figure E5.1. Describe the evolution of the network starting from the configuration 




Figure E5.1 Convex polygon for Exercise E5.1. The height of the polygon is strictly less 
that its width. 

depicted in Figure E5.1 and discuss its implication on the positive invariance of 
the set Q 2 \S CO mc with respect to CCven-obomcntr- 

E5.2 (Monotonic evolution of 7idc and 7i sp ). Prove the facts relative to statements 
(ii) and (iii) in Theorem 5.5. 
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Hint: Make use of the optimality of the Voronoi partition and of center locations 
stated in Propositions 2.19 and 2.21. 

E5.3 (Correctness of Lmtd-Vrn-cntrd) . Prove Theorem 5.5(v). 

Hint: To establish the monotonic evolution of the multicenter function, make use 
of the optimality of the Voronoi partition stated in Proposition 2.13 and of the 
centroid locations stated in Proposition 2.15. To establish the convergence result, 
make use of the LaSalle Invariance Principle stated in Theorem 1.19. 

E5.4 (Correctness of Rng-Vrn-cntrd). Mimic the proof of Theorem 5.5(iv) to 
show that the evolutions of Rng-Vrn-cntrd monotonically optimize the mixed 
distortion-area multicenter function 

W d ist-area,f ,b, with b = - diam(Q) 2 , 
and asymptotically approach its set of critical points. 

E5.5 (The "n-bugs problem" and cyclic interactions: cont'd). Consider n 
robots at counterclockwise-ordered positions 6i, . . . , 9 n . First, consider the cyclic 
balancing system described in Exercise El. 30 with parameter k = 1/4, and given 
by 

e t (t + i) = \e i+1 {i) + !&(/) + ifl«-i(i), £ e z> . 

Second, consider the Voronoi-centroid law on the circle (with uniform density) in 
which each robot computes its Voronoi partition of the circle (see Figure 2.5) and 
then moves to the midpoint of its arc. Show that the two behaviors are identical. 
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Chapter Six 

Boundary estimation and tracking 



The aim of this chapter is to provide an example of a motion coordination 
algorithm that can be used in a specific sensing task. This is the task of 
detection and estimation of an evolving boundary in two dimensions by a 
robotic sensor network. This type of operation can be of interest in the 
validation of oceanographic and atmospheric models, as well as for the de- 
marcation of hazardous environments. In the ocean, a boundary can delimit 
areas where there are abrupt changes in temperature, which can influence 
the marine biodiversity in those areas. In the atmosphere, a boundary can 
establish the front of a highly polluting expanding substance. The con- 
tainment of a spreading fire is another situation that can translate into the 
specific task of boundary estimation and tracking. 

Under full knowledge and centralized computation, various methods exist 
in the literature to solve the boundary estimation task. A first challenge 
that we face when designing coordination algorithms for robotic networks is 
the determination of the extent to which these tasks can be performed in a 
distributed way and under limited information. In this regard, the algorithm 
presented in this chapter to track environmental boundaries is distributed, 
in the sense that it does not require the use of a central station or "fusion 
center." Our algorithm builds on basic notions from interpolation theory 
and employs distributed linear iterations and consensus algorithms. The 
algorithm can be seen as part of a general effort to investigate distributed 
filters for estimation tasks. 

A second challenge is posed by sudden events that may occur when per- 
forming sensing tasks, such as the detection of an intruder or an abrupt 
change in the concentration of some chemical. These events require a spe- 
cific action on the part of the network. Since the timing of such events is 
not known a priori, this requires coordination algorithms that specify event- 
driven, asynchronous responses of the robotic network. We deal with this 
issue by building on the robotic network model proposed in Chapter 3. Our 
exposition here on boundary estimation relies on Susca (2007) and Susca 
et al. (2008). 
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The chapter is organized as follows. The first section extends the syn- 
chronous model proposed in Chapter 3 to include the event-driven, asyn- 
chronous operation of a robotic network. The second section reviews some 
basic facts on interpolation theory for boundaries. In the third section, 
we introduce the Estimate Update and Balancing Law to solve the 
boundary estimation task and analyzes its correctness. We end the chap- 
ter with three sections on, respectively, bibliographic notes, proofs of the 
results presented in the chapter, and exercises. Throughout the exposition, 
we make extensive use of polygonal approximations, geometric decomposi- 
tions, and consensus algorithms. The convergence analysis is based on the 
LaSalle Invariance Principle and on distributed linear iterations. 

6.1 EVENT-DRIVEN ASYNCHRONOUS ROBOTIC NETWORKS 

In what follows, we model "event-driven asynchronous" robotic networks. 
This model describes groups of agents that reset their processor states upon 
certain asynchronous events, that is, events that do not necessarily happen 
simultaneously for all agents. For example, a relevant event might be a robot 
reaching a location or leaving a region. The following event-driven model is 
convenient to describe our algorithm for boundary estimation, but its appli- 
cability extends beyond this particular scenario. Following our discussion of 
synchronous robotic networks in Section 3.1, the event-driven model consists 
of the following ingredients: a robotic network, as in Definition 3.2, and an 
event-driven control and communication law, as defined next. 

Definition 6.1 (Event-driven control and communication law). An 

event-driven control and communication law £CC for a robotic network S 
consists of the following sets: 

(i) A, a set containing the null element, called the communication 
alphabet — elements of A are called messages; 

(ii) W", i E I, called the processor state sets; and 
(iii) Wq C iyW, i El, sets of allowable initial values; 

and the following maps: 

(i) (msg-trig^, msg-gem',msg-rec^), i E I, called the message-trigger 
function, message-generation function, and message-reception func- 
tion, respectively, such that 

(a) msg-trigM : X® x W® -> {true, false}, 

(b) msg-genW : X^ x W^ x I ^ A, 

(c) msg-recW : X® x W® x A x I -> W®\ 
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(ii) (stf-trigj! ] ,stff ] ), i e I, k E {1,...,K® { }, called the k th state- 
transition trigger function and the k (processor) state-transition 
function, respectively, such that 

(a) stf-trig[! ] : X® x W® -» {true, false}, 

(b) stfj! 1 : X® x W® -» WW; and 

(in) ctl™ 1 : xW x W^ — > f/W, i e I, called (motion) control functions. 

If the network 5 is uniform and all sets and maps of the law ECC are inde- 
pendent of the identifier, that is, for all i € / and fe £ {1, . . . , if st f = iCLf}, 

WH = W, (stf-trig[! ] , st^ 1 ) = (stf-trig fc , stf fe ), ctl [i] = ctl, 
(msg-trig' 1 ' , msg-gen^ , msg-rec' 4 ' ) = (msg-trig, msg-gen, msg-rec) , 
then ECC is said to be uniform and is described by the tuple 

(A, W, {WS ] }i<=i, (msg-trig, msg-gen, msg-rec), {stf-trig fc , stf fc }^, ctl). • 

Observe that a key difference between Definitions 3.9 and 6.1 is that the 
message-generation and state-transition functions are substituted by sets 
of maps (msg-trig W, msg-gen'*', msg-rec' 4 ') and (stf-trigL , stff ). A second 
difference is that the control function depends only upon the current robot 
position, and not the position at last sample time. 

The event-driven control and communication law models situations in 
which the agent physical and processor states need to satisfy certain con- 
straints before a message should be sent. For example, in each triplet 
(msg-trig™, msg-genW,msg-recW), the map msg-trig™ acts as a trigger for 
agent i to send a message to its neighbors, the map msg-gen™ computes the 
message to be sent, and msg-rec' 4 ' specifies how agent i updates its proces- 
sor state when receiving a message. In hybrid systems terminology (van der 
Schaft and Schumacher, 2000), the map msg-trig' 4 ' can be seen as a guard 
map. Similarly, in the pair (stf-trigj, , sti k .), the map stf-trigj* acts as a trig- 

ger for agent i to update its processor state. If several stf-trigL are satisfied 
at the same time, then the agent can freely choose among the corresponding 
state transition functions to update the processor state. This freedom means 
that our dynamical system is described by a set-valued map and leads to 
non-deterministic evolutions. 

The evolution of a robotic network dictated by an event-driven control 
and communication law is asynchronous: there is no common time schedule 
for all robots to send messages, receive messages, and update their processor 
states. Only when an event happens, an agent sends a message or updates 
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its state. The asynchronous event-driven evolution can be loosely described 
in the following way: 

(i) Starting from the initial conditions, the physical state of each agent 
evolves in continuous time according to the control function ctl' 4 ' . 

(ii) At every instant of time t\ 6 M>o such that the message-trigger func- 
tion for agent i satisfies msg-trigW(xM(£i), w;M(£i)) = true, agent i 
generates a non-null message according to msg-gen^ and sends it 
to all its out-neighbors. At time £i, each out-neighbor j of agent 
i receives a messages and processes it according to msg-rec^. If 
multiple messages are received at the same time, then we allow all 
possible orders of execution of the message-reception function. 

(iii) Additionally, at every instant of time £2 £ ^>0 such that one of the 

state-transition triggers satisfies stf-trigj? (x^> (£2), w*- l > (£2), y'- 1 ' (£2)) = 

true, agent i updates its processor state w"' according to stfj* . If 
multiple state transitions are triggered at the same time, then we 
allow all possible orders of execution of the state-transition func- 
tions. 

(iv) If one or multiple state-transition and message triggers are equal to 
true at the same time, then we assume that all state transitions 
take place first, and immediately after the messages are generated 
and transmitted. 

(v) If one or multiple state-transition triggers are equal to true at the 
same time at which messages are received, then we allow all possible 
orders of execution of the state-transition and message-reception 
functions. 

(vi) In order to avoid the possibility of an infinite number of message 
transmissions or state transitions in finite time, we introduce a 
"dwell logic." Let 5 > be a dwell time common to all agents. 
For each agent i, if a message was generated at time £1 by agent 
i, then no additional message is to be generated before time £1 + e 
by agent i independently of the value of its message-trigger func- 
tion. Similarly, for each agent i, if a state-transition function was 
executed at time £2 by agent i, then no additional state-transition 
function is to be executed before time £2+6 by agent i independently 
of the value of its state-transition-trigger function. 

Remark 6.2 (Dwell time prevents Zeno behavior). Note that: (1) a 
dwell time is introduced only for the purpose of properly defining an exe- 
cution for a general event-drive control and communication law; (2) infinite 
numbers of message transmissions or state transitions in finite time will not 
take place during the execution of the algorithm that we present later in the 
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chapter; and (3) we refer the reader interested in comprehensive treatments 
of the so-called Zeno behavior to van der Schaft and Schumacher (2000); 
Johansson et al. (1999). • 

Finally, as we did in Chapter 3, we now give a formal definition of the 
asynchronous evolution of an event-driven control and communication law 
on a robotic network. 

Definition 6.3 (Asynchronous event-driven evolution with dwell 
time). Let ECC be an event-driven control and communication law for the 
robotic network S. For 5 E K>o, the evolution of (S,£CC) with dwell time 

\i] \i] 1*1 fil 

S from initial conditions x E Xq and w Q G Wq , i G /, is the collection of 
absolutely continuous curves x™ : K>o — > X^ l \ i G I, and piecewise-constant 
curves w'- 1 ' : M>o — > W^\ i G /, such that at almost all times, 

xW(t) = /(xM(t), ctlM(a;W(t),ti;M(t))), (6.1.1) 

u; [l] (£) = 0, (6.1.2) 

with x'^(0) = Xq and io^(0) = io , i £ I, and such that: 

(i) For every i E I and £i G M>o, a message is generated by agent i and 
received by all its out-neighbors j, that is, 

yf{t{) = msg-genW(a: [il (ti),w [<] (ti),j), 

w [ %i) =msg-rec b1 (x b1 (ti), lim u^(£),yj j] (£i)^), 

if msg-trigW(a;M(£i),u;M(£i)) = true and agent i has not trans- 
mitted any message to its out-neighbors during the time interval 
]t\ — 6, t\\ fl K>o. Here, agent j is an out-neighbor of agent % at time 

hii(i,j)eE cimn (x^(t 1 ),...,x^(t 1 )). 

(ii) For every i E I, k E {1, . . . , ^i t f}, and £2 G M>o, the state-transition 

fil 

function stfj, is executed, that is, 



w®(t 2 )=st^{x®(t 2 ), lim W [%)), 



t-»t; 



if stf-trig^ (#M (£2), 10^ (£2)) = true and there has been no execution 
of stfju during the time interval ]£2 — 6, £2[nK>o- • 

This model of event-driven control and communication law and of asyn- 
chronous evolution is adopted in the rest of this chapter. 
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6.2 PROBLEM STATEMENT 

In this section, we formalize the network objective. We begin by reviewing 
some important facts on interpolations of planar boundaries by means of in- 
scribed polygons. After introducing the robotic network model, we make use 
of notions from the theory of linear interpolations to formalize the boundary 
estimation task. 



6.2.1 Linear interpolations for boundary estimation 

Consider a simply connected set Q in M. 2 , that we term the body. We are 
interested in obtaining a description of the boundary dQ of a convex body. 
In particular, we will consider the symmetric difference error metric (Grubcr, 
1983) to measure the goodness of an approximation to dQ. The symmetric 
difference 5 between two compact bodies C, B CM. 2 is defined by 

5 s (C, B) = A(C UB)-A(CDB), 

where, given a set S C K 2 , A(5) is its Lebesgue measure. This definition 
is illustrated in Figure 6.1. We note that the symmetric difference admits 
alternative definitions (see Exercise E6.1). In what follows, we search for 




Figure 6.1 The symmetric difference between the two quadrilaterals is the area corre- 
sponding to the region colored in light gray. 

approximations to a convex body Q by means of inscribed polygons. A 
convex polygon is inscribed in Q if all its vertices belong to the boundary of 
Q. We denote an inscribed polygon with m vertices by Q m . The symmetric 
difference between the body Q and the polygon Q m takes the simpler form 

S s (Q,Q m ) = A(Q)-A(Q m ). 

The inscribed polygons that are critical points of 6 s can be characterized as 
follows. 
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Lemma 6.4 (Characterization of critical inscribed polygons for the 
symmetric difference). Let Q be a convex planar body with a continu- 
ously differentiable boundary. Let Q m be an inscribed polygon with vertices 
{qi, . . . , q m } in counterclockwise order. For i £ {1, . . . , m}, let t(qi) be the 
tangent vector to dQ at qi. Then, Q m is a critical point of 5 if and only if 

t(qi) is parallel to (qt+i — qi-i), (6.2.1) 

for alii £ {1, . . . , m}, where qo = q m and q m +i = q±. 

Note that the characterization of critical inscribed polygons in Lemma 6.4 
can be satisfied not only by polygons that are maximizers, but also by saddle 
points (see Exercise E6.2). On the other hand, we would like to make use of 
a characterization that can be extended to nonconvex bodies and that relies 
as much as possible on local information that agents can collect. 

In what follows, we describe the method of empirical distributions, based 
on the asymptotic formula provided in the following lemma. We start with 
some useful notation. As in Section 1.1, let dQ be twice continuously 
differentiable and let 7 arc : [0, L] — > dQ be a counterclockwise arc-length 
parametrization of dQ. Additionally, let K s igned : [0, L] — > K, K aDS : [0, L] — > 
R>o, and p : [0, L] — > K>o be, respectively, the signed curvature, the absolute 
curvature, and radius of curvature of the boundary. For convex bodies, the 
following result is proved in McLure and Vitale (1975), and Gruber (1983). 

Lemma 6.5 (Optimal polygonal approximation of a convex body). 

Let Q be a convex planar body whose boundary is twice continuously differen- 
tiable and has strictly positive signed curvature K s i gne d ■ If Qm is an optimal 
approximating polygon ofQ, then 

lim m *5 s (Q,Q m ) = ±- [ p{s?/*ds. 

m— >+oo 12 Jq 

To compute an optimal approximating polygon for a strictly convex body, 
McLure and Vitale (1975) suggest the following method of empirical distri- 
butions. Let qi, . . . ,q m be consecutive points on dQ ordered counterclock- 
wise and, for i £ {l,...,m}, define Si £ [0, L] by requiring qi = 7 arc (si). 
The positions qi, i £ {1, . . . , m}, along dQ are said to obey the method of 
empirical distributions if 

p(s) 2 / 3 ds= J 5 '' 1 p{s) 2/3 ds (6.2.2) 



for all z £ {1, ... , m}, where we set sq = s m and s m+ i = s\. Interpolating 
polygons computed according to the method of empirical distributions con- 
verge to an optimal polygon approximation Q m as m — > oo. Roughly speak- 
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ing, this property translates into the placement of more interpolation points 
on those parts of the boundary that have higher curvature. Figure 6.2.1 
illustrates an approximating polygon with empirically distributed vertices. 
As final comment about convex bodies, it is useful to know from Gruber 



Figure 6.2 Equidistant interpolation points according to the integral in equation (6.2.2). 
The solid green line represents the boundary and the dashed red line represents 
the optimal approximating polygon. 

(1983) that, for a > 0, 

/ p(s) a ds = [ RabsOO 1 ""^. (6.2.3) 

Jo Jo 

Next, we discuss the case of nonconvex bodies whose boundary can be 
parameterized by a twice continuously differentiable curve. We begin with 
a definition: given a twice continuously differentiable curve 7 : [0, L] — > M 2 , 
an inflection point of 7 is a point q £ 7QO, L]) with the property that, for 
Q = l(s q ), sign(K signed (s (? - e)) / sign(« signed (s g + e)) for every e £ R >0 
sufficiently small. Nonconvex bodies have an arbitrary number of inflection 
points; we restrict our attention to nonconvex bodies with a finite number 
of them. Because the radius of curvature of a nonconvex body is unbounded 
at inflection points, equality (6.2.2) is ill posed in general. Therefore, in 
order to extend the method of empirical distributions to nonconvex bodies, 
we introduce the following notions of distance along a boundary. Given two 
points qi = 7 arc ('Si) and qj = "furdsj), with Sj < Sj, we define 



-i 
Daxcylii Qj) — Sj $i- 



Note that the quantity T> arc (qi,qj) is always strictly positive for qi / qj, 
whereas the quantity ^curvature (<Zi) Qj) vanishes if the points <& and qj are 
connected by a straight line. Additionally, for A £ [0,1], we define the 
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pseudo-distance T>\ between the vertices qi and qj as 

T>x(qi, qi+i) = A£> curvature (<?i, qj) + (1 - A)£> arc (%, q i+1 ). 

The empirical distribution criterion (6.2.2) is substituted by the following 
one when the boundary is nonconvex. We look for approximations of dQ, 
{qi,...,q m }, such that T>x(qi-i,qi) = T>x(q l ,q i+ i) for all i G {l,...,m}. 
This choice has the following interpretation. Taking A ~ 1 leads to an 
interpolation that satisfies a modified method of empirical distributions. 
The method is modified in the sense that we adopt the distance ^curvature 
instead of the integral of the curvature radius; our informal justification for 
this step is equality (6.2.3). Instead, taking A ~ leads to an interpolation 
that divides the boundary into segments of equal arc-length. A choice of 
A G (0, 1) leads to a polygon approximation that is midway between these 
two options. For sufficiently large A < 1, the resulting polygon has a higher 
number of vertices in the portions of the boundary with higher curvature and 
the distance between any two consecutive interpolation points is guaranteed 
to be positive. 



6.2.2 Network model and boundary estimation task 

Next, we formulate a robotic network model and the boundary estimation 
objective. Assume that Q is a simply connected subset of M 2 with differ- 
entiable boundary dQ. Consider the network <Sb n dr y = (^i^cmm)i with 
/ = {1, . . . , n}. In this network, each robot is described by a tuple 

(dQ, [-v min , v max ),8Q, (0, e)), (6.2.4) 

where e is the vector field tangent to dQ describing counterclockwise motion 
at unit speed; we assume that unit speed is an admissible speed, that is, we 
assume that 1 G [— v m [ n , v max \. We assume that each robot can sense its 
own location pW g QQ^ { g J ) an d can communicate with its clockwise and 
counterclockwise neighbors along dQ. In other words, the communication 
graph -Ecmm is the ring graph or the Delaunay graph on dQ. Later, we shall 
assume that Q varies in a continuously differentiable way with time, and 
that, therefore, agents move along its time- varying boundary. 

Next, assume that the processor state of each agent contains a set of n{ p 
interpolation points used to approximate dQ, that is, the processor state is 
given by q'- 1 ' G (M 2 ) nip , for i G /. We illustrate the combination of agents 
and interpolation points along the boundary in Figure 6.3. 

For e G M>o and A G [0, 1], the boundary estimation task 2^-bndry : (dQ) n x 
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Figure 6.3 Agents and interpolation points on the boundary dQ. 

((M 2 )" lp ) n — > {true, false} for <Sb n dry is the coordination task 

Te-bndry (p [1] , ■ • • , P [n] , 9 [1] , • ■ ■ , <? H ) = true if and only if 

Vxtia-i, q§) ~ V x (q®,q® + i))\ < e, a € {1, ... , n ip } and i 6 J. 

Roughly speaking, this task is achieved when the n; p interpolation points 
are approximately uniformly placed along the boundary according to the 
counterclockwise pseudo-distance T>\. 

A second objective is our desire to space the agents equally far apart 
along the boundary. As in Example 3.22, for e > 0, we define the agent 
equidistance task ^-eqdstnc : {9Q) n — > {true, false} to be true if and only 
if 

|^arc(p [i -V ?1 ) " ^arc(p H ,P [l+1] )| < S, for all i £ /, 

where T> wc is the counterclockwise arc- length distance along dQ. In other 
words, 7^_ eq dstnc is true when, for every agent, the (unsigned) distances to 
the closest clockwise neighbor and to the closest counterclockwise neighbor 
are approximately equal. 

6.3 ESTIMATE UPDATE AND CYCLIC BALANCING LAW 

Here, we propose a coordination algorithm for a robotic network to achieve 
the boundary estimation task. The algorithm requires individual agents to 
maintain and continuously update an approximation of the boundary that 
asymptotically meets the criterion of the method of empirical distributions. 
The algorithm is an event-driven control and communication law, as defined 
in Section 6.1. To facilitate the understanding, the algorithm is presented 
in an incremental way. First, we specify an estimate update law for a sin- 
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gle robot. Second, we consider multiple robots cooperatively performing 
the estimate update law to achieve the boundary estimation task. Third 
and finally, we introduce a cyclic balancing algorithm to achieve a robot 
equidistance task. 



6.3.1 Single-robot estimate update law 

Let Q be a simply connected subset of M 2 with a differentiable moving 
boundary dQ. Consider a single robot described by (6.2.4) that moves 
along dQ. Assume that the processor state contains a set of interpolation 
points {(/i, . . . , gVi ip } used to approximate dQ. We begin with an informal 
description of the Single- Robot Estimate Update Law and we illustrate 
in Figure 6.4 the two actions characterizing this law: 

[Informal description] The agent moves counterclockwise along 
the moving boundary dQ, collecting estimates of its tangent and 
curvature. Using these estimates, the agent executes the fol- 
lowing two actions. First, it updates the positions of the in- 
terpolation points so that they take value on the estimate of 
dQ. In other words, as sufficient information is available, each 
interpolation point q a , a £ {l,...,rii p }, is projected onto the 
estimated boundary. Second, after an interpolation point q a has 
been projected, the agent collects sufficient information so that 
it can locally optimize the location of q a along the estimate of 
dQ. Here, by an estimate of the time-varying dQ, we mean the 
trajectory of the agent along the moving boundary. 



-O 



Figure 6.4 The two actions characterizing the Single-Robot Estimate Update Law. 

Next, we begin our detailed description of the algorithm by specifying 
what variables the agent maintains in its memory. The processor state of 
the agent consists of the following variables: 

(i) A counter nxt taking values in {1, . . . , n; p } that specifies which in- 
terpolation point the agent is going to project next. 
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(ii) A boundary representation comprised of the pairs 

{( fo t) a )e(R 2 ) 2 |ae{l,... 1 n ip }} ) 

where q a is the position of the interpolation point a and v a repre- 
sents the tangent vector of dQ at q Q . 

(iii) A curve of the form path : [0,t] — > M 2 . This curve is the trajectory 
followed by the agent from initial time until present time t. We 
assume that the agent updates the variable path continuously. We 
let C(R 2 ) be the set of planar curves, that is, twice differentiable 
functions from an interval to M 2 . With this notation, we may write 
pathe C(R 2 ). 




Figure 6.5 The agent moves along the time- varying boundary dQ, here depicted as a 
sequence of growing ellipses, and its trajectory is an approximation to dQ. 

Remark 6.6 (Boundary approximation). For simplicity, we assume 
that, at every instant of time, the agent is located exactly on top of the 
boundary. This assumption implies that if the boundary is time-invariant, 
then the agent trajectory path is locally equal to dQ. Furthermore, if the 
boundary is slowly time-varying, then the agent's trajectory path is an es- 
timate of the moving boundary dQ, as illustrated in Figure 6.5. • 

The agent updates its processor state according to the following two rules: 

Rule #1: When and how to project onto dQ the interpolation point q nxt - 
Let q nxt denote the interpolation point about to be projected and let v nxt 
denote the corresponding tangent vector. The projection takes place when 
the agent crosses the line, denoted by line nxt , that passes through q nxt 
and is perpendicular to u nx t- At this crossing time, we define the updated 
values for the interpolation point nxt, denoted by q^ xt , to be the point on 
path where the agent's trajectory crosses the line line nxt . This projection 
operation is illustrated in Figure 6.6. We refer to this operation by the map 
perp-proj : (K 2 ) 2 x C(R 2 ) — > M 2 ; in other words, we write 

<?it : = perp-proj (q nxt ,v nxt , path). 
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9nxt-i q nKt 



9nxt-2 
Figure 6.6 The projection of interpolation point g nxt onto the curve path. 



Rule #2: When and how to optimize the interpolation point q nx t-i- The 
local optimization of the interpolation point (nxt — 1) takes place immedi- 
ately after the projection of the interpolation point nxt onto the estimated 
boundary. The interpolation point (nxt — 1) is moved along the curve path 
in order to balance its two pseudodistances to its clockwise and counter- 
clockwise neighboring interpolation points (recall that path is an estimate 
of the boundary dQ as discussed in Remark 6.6). Specifically, we define the 
map cyclic-balance : (R 2 ) 3 x C(R 2 ) -> R 2 by 

cyclic-balance(g nxt _2, Q'nxt-ij 5nxt)P a "th) is point q* in the curve path 

3 1 

SUCh that T> X (qnxt-2,q*) = -£>A(<?nxt-2, <?nxt-l) + -£>A(<?nxt-l, <7nxt ) • 

This map is illustrated in Figure 6.7. With this definition, we update the 
interpolation (nxt — 1) to be 

itxt-i '■= cyclic-balance(g nxt _2,g nx t-i,<?nxt,path). 



n 



V 



s 


o 




o 





9nxt-l 




9nxt 


9nxt-2 




<Znxt-l 





Figure 6.7 Optimal placement of the interpolation point qw-1 along the curve path. 

Remark 6.7 (Balancing property of the optimal placement). The 

optimal placement q^ JLt _i can be equivalently defined by 

1 3 

^M^nxt-l'^nxt) = jT^\{qnxt-2,qnxt-l) + -^M^nxt-l , <2nxt ), 
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so that it achieves the balancing property that 



D \(q n xt-2, qnxt-l) 

'D\(q BX t-i,Qnxt)- 



Z>A(ftixt-2,fiit_i) _ I 3 1 
. 2?A(^t_i,«nrt) J " 4 [l 3 

This iteration is the same as the cyclic balancing system with parameter 
k = 1/4 studied in Exercises El. 30, E5.5, and E6.3. • 



Finally, we define one last useful operation. Given a point on the curve 
path, it is useful to be able to compute the tangent of the curve path at the 
point q. Specifically, given a point q on the curve path, we shall write 

V := tangentat(path, q). 

In summary, the Single-Robot Estimate Update Law is formally de- 
scribed as follows: 

Robot : single robot moving at constant speed along dQ, 
continuously recording its trajectory 

Event-driven Algorithm: Single- Robot Estimate Update Law 

Processor State: w = (nxt, {(<7a,i>a)} a =i! path), where 

nxt G {1, ... ,i-ip}, initially equal to index of interpola- 

tion point closest to robot moving 
counterclockwise 
{(q a ,Va)}a=iC M 2 x M 2 , initially counterclockwise along boundary 
path G C(M 2 ), continuously recording agent's trajectory 

% A state transition is triggered when the agent crosses a certain line 
function stf-trig(p, w) 

l: line nxt := line through point q nxt perpendicular to direction v nxt 

2: if p G line nxt then 

3: return true 

4: else 

5: return false 

% The current interpolation point and tangent vector are projected and the 

previous interpolation point is optimized along the new boundary 
function stf(p, w) 



perp-proj (q^ t , u nxt ,path) 

cyclic-balance(q nxt _2,gnxt-i,git>P at h) 
tangent at (path, g+ t ) 
tangent at (path, g^ rt _ 1 ) 



inxt-l 

„ + 



-nxt-1 



return (nxt + 1, {(<?+ , w+ )} a i ^ 1 ,path) 
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The Single- Robot Estimate Update Law may be improved in a num- 
ber of ways; here, we present some important algorithmic clarifications. 



Remarks 6.8 (Content and representation of the variable path). 

(i) The above discussion assumes that, with the information provided 
by the variable path, the agent can compute the tangent vector and 
the curvature along its trajectory in order to perform the calculation 
of the pseudodistance T>\. 

(ii) It is not necessary for the agent to keep in the variable path its 
entire trajectory since initial time. In fact, when the agent updates 
the location of the interpolation point (nxt — 1) in instruction 4: of 
the state-transition function, it is sufficient that path contains the 
trajectory of the agent starting from interpolation point (nxt — 2) 
until the current agent position. This "limited-length" requirement 
may be implemented as follows: the variable path is a curve of the 
form path : [t pat h, t] — > M 2 , the variable t denotes the present time, 
the variable tp ath is initially set equal to 0, and the instruction 

tpath := t* such that q nxt -i = path(i*), 

is executed before instruction 6: in the state-transition function. 

(iii) In a realistic implementation, the path variable and its first two 
derivatives are to be represented with finite resolution over a discrete 
time domain. The interested reader is referred to Susca et al. (2008) 
for a discussion of the Single-Robot Estimate Update Law 
algorithm with a realistic implementation of the path variable in a 
finite- length finite-resolution manner. • 

Remark 6.9 (Timeout for the projection of interpolation points). 

In the definition of the Single-Robot Estimate Update Law, we have 
implicitly assumed that the agent crosses the line through q nxt perpendicu- 
lar to Unit. This is certainly the case if dQ is static or slowly time- varying. 
However, if dQ changes drastically, it is conceivable that the agent never 
crosses the line through q nxt perpendicular to v nxt . In other words, it can 
happen that the state-transition trigger function is always false. This sit- 
uation can be prevented by prescribing a timeout such that, if the agent 
has not crossed the line after a certain time has elapsed, then the interpo- 
lation point nxt is projected onto its trajectory anyway. Formally, let t* be 
implicitly defined by 

If no crossing has happened at time t, then q^ xt is set equal to the point 
on path that is closest to q nxt - The tangent vector v^ xt is set equal to 
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tangentat(path, q^ t ). This projection is well-defined and has the property 
that if dQ is time- invariant, then q^ t = q nxt - The algorithm described 
by Susca et al. (2008) explicitly incorporates this timeout. • 



6.3.2 Cooperative estimate update law 

In the previous section, we presented an event-driven algorithm for a single 
robot to monitor a boundary. We consider the robotic network 5 Dn dry w hh 
ring communication topology, described in Section 6.2.2, and we develop a 
parallel version of the Single- Robot Estimate Update Law that allows 
the network to monitor the boundary efficiently (i.e., with more accuracy 
than a single robot could). We begin with an informal description of the 
Cooperative Estimate Update Law: 

[Informal description] Each agent moves counterclockwise along 
the moving boundary dQ, has its individual copy of the bound- 
ary representation, including the interpolation points, and exe- 
cutes the Single- Robot Estimate Update Law. Because the 
agents are spatially distributed, each agent updates its individ- 
ual boundary representation separately. On top of the Single- 
Robot Estimate Update Law, the agents run a communi- 
cation protocol that transmits the updated interpolation points 
along the ring topology. Specifically, every time an agent updates 
two interpolation points (using the state-transition function of 
the Single-Robot Estimate Update Law and, thus, the 
functions perp-proj and cyclic-balance), this agent transmits 
these updated interpolation points to its clockwise and counter- 
clockwise neighbors. In turn, the neighbors record the updates 
in their individual boundary representation. 

Next, we give a more detailed description of the algorithm. We assume 
that each robot i has a processor state with its local copy of w'- 1 ' containing a 
counter nxt^, a boundary representation {(q& , Va )}a=i) where n- ip is equal 
for all robots, and its pathH. The Cooperative Estimate Update Law 
is formally described as follows: 

Robotic Network : 5 D ndry) first-order agents moving at unit speed along dQ 
with absolute sensing of own position, communicating 
with clockwise and counterclockwise neighbors 



Event-driven Algorithm: Cooperative Estimate Update Law 
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Processor State, function stf-trig, and function stf 

same as in Single-Robot Estimate Update Law 

% A transmission is triggered right after the interpolation points are updated 
function msg-trig(p, w) 
l: return stf-trig(p, w) 

% The updated interpolation points (and reference label) are transmitted 
function msg-gen(p, w, i) 

l: return (nxt, (g nxt _i, ?W-i), (<W-2,iW-2)) 

% The received updated interpolation points are stored 
function msg-rec(p, w, y, i) 

i: {(fl£,«J)}£i:={(fe,««)}£i 

2: (nxtrec,yi,y 2 ) := V 

3: Wnxtrec-l'^nxtrec-l) := 2/1 
4: Wnxtrec-2' U nxtrec-2) := 2/2 

5: return (nxt, {(<?+, v+)}^ l5 path) 

We conclude this section with an important clarification. We begin with 
a useful definition and then give two related remarks. 

Definition 6.10 (Two-hop separation). A group of n > 2 agents imple- 
menting the Cooperative Estimate Update Law is two-hop separated 
along the interpolation points if nxt'* -1 ' < nxt' 1 ' — 2 for all i € I at all times 
during the execution of the algorithm. • 



Remarks 6.11 (Well-posedness of the Cooperative Estimate Up- 
date Law). 

(i) The inequality nxt' J-1 l < nxt' l l — 2 guarantees that each robot can 
correctly implement the algorithm. Indeed, if this inequality is vi- 
olated, then the cyclic-balance function performed by robot i 
during the state-transition function is invoked with an interpola- 
tion point ^xt-2 which does not take value in the curve path^ 
(because the boundary might be time- varying) . This inequality 
therefore guarantees that the algorithm is well-posed. Assuming 
two-hop separation guarantees that the projection and optimiza- 
tion events happen in the following order: each interpolation point 
nxt'^ is projected and later optimized by robot i, strictly before it 
is projected by robot [i — 1). 

(ii) The two-hop separation property is easily seen to hold when (1) the 
number of interpolation points nj p is much larger than the num- 
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ber of robots n, (2) the robots are approximately equidistant along 
dQ, and (3) the distances between pairs of consecutive interpolation 
points are much less than the length of dQ divided by n. • 



6.3.3 Cyclic balancing algorithm for agent equidistance task 

Here, we propose a motion coordination controller to achieve the agent 
equidistance task ^-eqdstnc among the agents moving along the boundary. 
This task also leads to the orderly interactions mentioned in the last remark. 
Specifically, we extend the Cooperative Estimate Update Law to in- 
clude a motion coordination component that makes the agents achieve the 
agent equidistance task while moving at approximately unit speed along the 
boundary. The control design is straightforward: for robot i at position p" 
moving in continuous time with speed v^> along dQ, we define 

V [t] = 1 + fc prop (D arc (pH,^ +1 ]) " ^arc(p [ *- 1] ,P H )), (6.3.1) 

where k prop £ M>o is a fixed control gain. In other words, the agent speeds 
up or slows down depending upon whether it is closer to the following 
or to the preceding agent, respectively. This simple motion control law 
is the continuous-time analog of the cyclic balancing system described in 
Exercise El. 30; recall that this system was adopted also in the Single- 
Robot Estimate Update Law for the purpose of balancing pseudodis- 
tances among interpolation points. 

To handle the lower and upper bounds constraints on the velocity, that 
is, the constraint v £ [— v m m , Bmav] , we introduce a saturation function in 
the design (6.3.1). Specifically, we implement 

V® = Sat Kin)W] (l + Vop(^arc(p H ,P [l+1] ) " Z>arc(p [< ~ 1] ,P W ))) , (6.3.2) 

where the saturation function satr a m : R — > [a, b], for a < b, is defined by 



8at[ 0j6 ](x) 



a, if x < a, 

x, if x € [a, b], 

b, if x > b. 



The difficulty in implementing controller (6.3.2) in the COOPERATIVE 
Estimate Update Law is how to measure the counterclockwise arc-length 
distance between robots. To tackle this difficulty, let us begin with a useful 
observation. Given the interpolation points {q±, . . . ,q Ui } and two points 
on the boundary n, r2, assume that sufficient information is available to 
compute the indices [r\] and [r2\ of the counterclockwise-closest interpolation 
points from n, rz, respectively. With this notation and the assumption, 
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the counterclockwise pseudo distance from n to r 2 and one of its possible 
approximations are as follows: 

N-2 

T>aic{ri,r 2 ) =T> aC c{r\,q[r 1 \) + ^2 ^(?a, Qa+l) + ^arc(9[r 3 ]-l,^2) 

a=[ri] 

(6.3.3) 
M-2 
«dist 2 (ri,g[ ri ])+ ^ dist 2 (q r a,fe+i) + dist 2 (g[ r2 ]_i,r 2 ). 

a=[ri] 

(6.3.4) 

Based on this equality and on this approximation, we propose two meth- 
ods to implement the controller (6.3.2). One may implement either of the 
following: 

(i) The approximation proposed in (6.3.4); this approximated pairwise 
counterclockwise arc-length distance may be computed with the in- 
formation available to the agents in the COOPERATIVE ESTIMATE 
Update Law. 

(ii) The exact computation proposed in (6.3.3); in order to perform this 
computation, however, the robots require more information. The 
processor state is required to store a collection of arc-length dis- 
tances T> axc (q on q a+ \), a £ {l,...,n; p } that are measured by the 
agents as they move, and that are maintained accurate via commu- 
nication. In the interest of brevity, we omit a detailed discussion of 
this point here. 

Finally, independently of the computation or approximation of the arc- 
length distances, the implementation of controller (6.3.2) requires each agent 
to have a continuous-time estimate of the location of its clockwise and 
counterclockwise neighbors: this information may be acquired by either a 
dedicated message-exchanging protocol or, possibly, by proximity sensors 
mounted on the robots. In the interest of brevity, we omit a detailed dis- 
cussion of this point here. 



6.3.4 Correctness of the estimate update and cyclic balancing law 

We call the Estimate Update and Balancing Law the combination 
of the Cooperative Estimate Update Law with the cyclic balancing 
control law (6.3.2), with exact arc-length distance computation between 
robots. 
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We call the Approximate Estimate and Balancing Law the combi- 
nation of the Cooperative Estimate Update Law with the cyclic balanc- 
ing control law (6.3.2), with (1) finite-resolution finite-length representation 
of the path variable in the robots, and (2) approximate arc-length distance 
computation between robots. 

We state the properties of these laws in the following theorem, whose 
proof is postponed to Section 6.6. 

Theorem 6.12 (Correctness of the exact and approximate laws). 

On the network 5 Dn dry> along evolutions with the two-hop separation prop- 
erty: 

(i) the Estimate Update and Balancing Law achieves the bound- 
ary estimation task 7^_b n dry and the agent equidistance task T £ _ eq dstnc 
for any e £ M>o if the boundary is time-independent; and 

(ii) the Approximate Estimate and Balancing Law achieves the 
boundary estimation task 7^_bndry and the agent equidistance task 
^e-eqdstnc f or some e £ M>o if the boundary varies in a continuously 
differentiable way and sufficiently slowly with time, and its length is 
upper bounded. 

Remark 6.13 (Error induced by the evolution of the boundary and 
its discretization). In the second statement in the theorem, the constant 
£ depends upon the rate of change of the boundary and upon the accuracy 
of the various approximations made in the algorithm. • 

6.4 SIMULATION RESULTS 

In order to illustrate the performance of the algorithms, we include here dif- 
ferent simulation results of the Approximate Estimate and Balancing 
Law. In the first simulation, the boundary to be estimated is time invariant, 
while in the second it is time-varying. 



Time-invariant boundary 

As a first simulation, we assume that n = 3 agents aim to approximate the 
time-invariant boundary dQ described by the closed curve 



7 (0) = (2 + cos(5(9) + O.5sin(20)) 



cos(0) 
sin(0) 



£ [0,2tt]. 



The control gain is k pTop = 0.05. The minimum and maximum velocities are 
v m m = 0.5 and v max = 2. The number of interpolation points is n- ip = 30. 
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Pseudodistances are computed with A = yy. The simulation time is 50 
seconds. At initial time, the interpolation points are selected to be the posi- 
tions of the agents and other randomly distributed points on the boundary. 
Finally, each robot maintains a discretized representation of its trajectory 
path with a resolution of 0.01 seconds. 

The behavior of the Approximate Estimate and Balancing Law is 
illustrated in Figure 6.8. The left- and right-hand figures correspond to 
the positions of the interpolation points and the agents at the initial and 
final configurations, respectively. In the right-hand figure one can see the 
approximating polygon and how close it is to the actual boundary. 



Initial Configuration 




Final Configuration 




Figure 6.8 The Approximate Estimate and Balancing Law for a time-invariant 
boundary: initial and final configuration of agents (drawn as triangles) and 
interpolation points. The right-hand figure shows also the approximating poly- 
gon. 

Figure 6.9 illustrates the convergence of the algorithm. Although the Ap- 
proximate Estimate and Balancing Law uses an approximated version 
of the pseudodistances between interpolation points and of the arc-length 
distance between agents, we illustrate the performance of the algorithm by 
plotting the exact versions of the pseudodistances and arc-length distances. 
Regarding the boundary estimation task, the left-hand figure illustrates how 

the quantity max ag{1 n . p} V x {q a , q a +i) ~ T®in a e{l,...,n ip }'D\(Qa,qa+i) does 

indeed decrease towards zero, even though it does not vanish because of 
the adopted approximations. Regarding the equidistance task, the right 
figure illustrates how the agents become uniformly spaced along the bound- 
ary. Again, the arc-length distances converge toward a common steady-state 
value, even though the convergence is not exact because of the adopted ap- 
proximations. 
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max D \ — min D 




Arc- length distances 



time (sec) 



time (sec) 



Figure 6.9 The Approximate Estimate and Balancing Law for a time-invariant 
boundary: the left-hand figure shows the largest minus the smallest pseu- 
dodistance between neighboring interpolation points. The right-hand figure 
shows the three arc-length distances between the three agents. 



Slowly time-varying boundary 

As a second simulation, we assume that n = 4 agents aim to approximate 
the time-varying boundary dQ described by the time-varying closed curve 



7(M) 



, '■final v 
'■final 



+ (2 + cos(50) + O.5sin(20) 



t 



''final 



cos(0) 
sin(0) 



with 6 g [0, 1], t G [0, tfi na i], and £ nna i = 200 seconds, as shown in Figure 6.10. 
The parameters and initial conditions of the Approximate Estimate and 
Balancing Law are the same as in the time-invariant case. The four plots 
in Figure 6.10 show the positions of the interpolation points and of the 
agents at the four time instants 0, 50, 100, and 200 seconds, respectively. 
The last plot also illustrates how close the approximating polygon is to the 
actual boundary. From the frames in Figure 6.10, it is clear that the agents 
can adapt as dQ changes. 

6.5 NOTES 

For a discussion of hybrid systems we refer to van der Schaft and Schumacher 
(2000). Other relevant references include Lygeros et al. (2003), Goebel et al. 
(2004), and Sanfelice et al. (2007). 

Many methods are currently available (Mehaute et al., 1993) for the ap- 
proximation of planar curves; this fact is largely motivated by computational 
and signal-processing applications. Among them, the use of interpolated 
curves is a standard and important approach. In their most simple version, 
interpolations provide polygonal approximations of curves, with generaliza- 
tions that make use of splines, or combinations of functions in a certain basis. 
In particular, the problem of characterizing the polygons that optimally ap- 
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Initial Configuration 



-2.5 -2 -1.6 -1 -TL5 0.5 



.5 2 2.5 




t = 50 sec 




-2.5 -2 -1.5 -1 -0.5 0.5 1 1.5 2 2.5 



Final Configuration 




Figure 6.10 The Approximate Estimate and Balancing Law for a time- varying 
boundary: the configuration of the agents (drawn as triangles) and inter- 
polation points at time instants 0, 50, 100, and 200 seconds. The last figure 
also shows the approximating polygon. 



proximate a closed, convex body is a classical one; see the survey by Gruber 
(1983). In particular, the asymptotic formula in Lemma 6.5 was extended 
in (Gruber, 1983) to higher dimensions in terms of the Gauss curvature. 

Boundary estimation and tracking is useful is numerous applications such 
as the detection of harmful algal blooms (Marthaler and Bertozzi, 2003; 
Bertozzi et al., 2004), oil spills (Clark and Fierro, 2007), and fire contain- 
ment (Casbeer et al., 2005, 2006). Marthaler and Bertozzi (2003) adopt the 
so-called "snake algorithm" (from the computer vision literature) to detect 
and track the boundary of harmful algal bloom. Each agent is equipped with 
a chemical sensor that is able to measure the concentration gradient and with 
a communication system that is able to exchange information with a data fu- 
sion center. Bertozzi et al. (2004) suggest an algorithm that requires only a 
concentration sensor: the agents repeatedly cross the region boundary using 
a bang-bang angular velocity controller. Clark and Fierro (2007) use a ran- 
dom coverage controller, a collision avoidance controller, and a bang-bang 
angular velocity controller to detect and surround an oil spill. Casbeer et al. 
(2006) describe an algorithm that allows Low Altitude Short Endurance 
Unmanned Vehicles (LASEUVs) to closely monitor the boundary of a fire. 
Each of the LASEUVs has an infrared camera and a short-range communi- 



265 



"Distributed Control of Robotic Networks" by F. Bullo, J. Cortes and S. Martinez 
Copyright © 2006-2009. Manuscript under contract. This version: March 22, 2009 



DCRN March 22, 2009 



cation device to exchange information with other agents, and to download 
the information collected to the base station. In Zhang and Leonard (2005), 
a formation of four robots tracks at unitary speed, the level sets of a field. 
Their relative positions change, so that they can optimally measure the gra- 
dient and estimate the curvature of the field in the center of the formation. 
In Zhang and Leonard (2007), a controller is proposed to steer a group of 
constant-speed robots onto an equally spaced configuration along a close 
curve. 

6.6 PROOFS 

This section presents the main result of the chapter on the correctness of 
Theorem 6.12. For the sake of completeness, we review first some notations 
and main concepts for Input-to-State-Stability (ISS) of discrete-time sys- 
tems, as introduced in Angeli (1999), Jiang and Wang (2001), and Angeli 
(1999); Sontag (2008). We then make use of these to prove the result of 
Theorem 6.12. 



6.6.1 Review of ISS concepts 

A function 7 : M>o — > M>o is a IC-function if it is continuous, strictly 
increasing, and 7(0) = 0. A function (3 : R>o X R>o — > M>o is a tCC-function 
if, for each t £ K>o, the function s 1— > P(s,t) is a /C-function, and for each 
s £ M>o, 1 1— > j3{s,t) is decreasing and (3(s,t) — > as t — > +00. 

Consider the discrete-time nonlinear system 

x(£ + l) = f(x(£),u(£)), (6.6.1) 

where £ takes values in Z>o, x takes values in M n , and u takes values in R m . 
We assume that / : Z>o x W 1 x R m — > R n is continuous. In what follows, 
we let ||u||2,oo = sup{||u(£)||2 | £ £ Z>o} < +00. 

Definition 6.14 (Input-to-state stability). The system (6.6.1) is input- 
to-state stable (ISS) if there exist a /C£-function f3 and a /C-function 7 such 
that, for each initial condition xq £ W l at time £q £ Z>o and for each 
bounded input u : Z>o — > W n , the system evolution x satisfies, for each 
£>£o, 

M£)h < P(\\xo\\ 2 J - £0) + l(\\u\\ 2 ,oo). 

Definition 6.15 (ISS-Lyapunov function). A function V : M" - 
is an ISS-Lyapunov function for system (6.6.1) if: 

(i) it is continuously differentiable; 



266 



"Distributed Control of Robotic Networks" by F. Bullo, J. Cortes and S. Martinez 
Copyright © 2006-2009. Manuscript under contract. This version: March 22, 2009 



DCRN March 22, 2009 



(ii) there exist JCoo -functions, a\, a 2 , such that cti ( || £c || 2) < V(x) < 
c^dMh); and 

(iii) there exist a /Coo-function 03 and a /C-function a such that 

V(f(x,u)) - V(x) < -a 3 (\\x\\ 2 ) + a(\\u\\ 2 ). 

We refer to Jiang and Wang (2001) for a proof of the following result. 

Theorem 6.16 (ISS and Lyapunov functions). System (6.6.1) is ISS 
if and only if it admits an ISS-Lyapunov function. 

6.6.2 Proof of Theorem 6.12 



Proof. In the interest of brevity, we prove only the statements that pertain 
to the boundary estimation task 7^_b n dry> that is, to the task 

-Dx^qW) -V x (q®,q® +1 ))\< e, 

for all a G {1, . . . , ri; p } and i £ I. We refer to Susca et al. (2008) for the 
proof of the statements regarding the agent equidistance task. 

We begin our analysis with the case of a single robot, that is, we con- 
sider the Estimate Update and Balancing Law algorithm, and we 
first consider the case of a time-invariant boundary with exact path rep- 
resentation and with no approximations in any computation. Define the 
shorthand V a = V\(q a ,q a+ i), for a G {1, . . . ,nj p }, and the positive vector 
V = (T>i, . . . ,T> n . p ) G M^q . We now characterize how the vector T> changes 
after one application of the state-transition function with counter nxt in 
the Single-Robot Estimate Update Law. We refer to an application 
of the state-transition function as a projection-and-placement event. Be- 
cause the boundary is time-invariant, the projection operation (performed 
by the function perp-proj) leaves the interpolation point g nxt unchanged. 
Furthermore, as discussed in Remark 6.7, the placement operation (per- 
formed by the function cyclic-balance) modifies the interpolation point 
tfnxt-i so that 



Aixt-2 


+ 1 


3 


1 




Aixt-2 


£nxt-l_ 


4 


1 


3 




Aixt-i 



where we adopt the shorthand D+ = T>\(q+, g^.j), for a G {1, 



,n ip }. For 



267 



"Distributed Control of Robotic Networks" by F. Bullo, J. Cortes and S. Martinez 
Copyright © 2006-2009. Manuscript under contract. This version: March 22, 2009 



DCRN March 22, 2009 




nxt G {1, . . . , n ip }, define A nxt G M"ip xn 'p by 

if (j, k) equals (nxt — 1, nxt — 1) or (nxt — 2, nxt — 2), 
(Aixt)jfc = { 1/4, if (j, k) or (j, k) equals (nxt - 1, nxt - 2), 
otherwise 

and define the undirected graph G nxt with vertices {1, . . . , rn p } and with the 
single edge (nxt — l,nxt — 2). In summary, the matrix A nxt determines the 
change of state T> + = A nxt T> when a projection-and-placement event takes 
place with counter nxt and its associated graph is G nxt . 

Because the boundary has finite length and the agent moves at lower- 
bounded speed, an infinite number of projection-and-placement events take 
place for each interpolation point. After a re-parametrization of time, let 
£ G N denote the times at which projection- and-placements events take place 
and let nxt(^) G {1, . . . , n; p } denote the index corresponding to the event 
taking place at time £. At each time £ G N, we write 

V(£) = A nxt{e) V(£-l). (6.6.2) 

Next, note that A nxt (i)i f° r ^ G N, is a non-degenerate sequence of symmet- 
ric and doubly stochastic matrices. Additionally, note that the undirected 
graph U T >^G nxt ( T ) is connected. Therefore, by Theorem 1.65 and Corol- 
lary 1.70, we know that, for all a G {1, . . . , n; p }, 

1 ™ 1P 1 

lim T> a (£) = — } £>a(0) = — (total pseudodistance length of dQ). 
£_>+«, nip z-^ n ip 

This proves that the interpolation points become equally spaced along dQ 
with respect to pseudodistance and that the boundary estimation task is 
achieved in the time-invariant case. In other words, this concludes the proof 
of the boundary estimation part of statement (i) for a single robot in The- 
orem 6.12. 

Next, we consider the Cooperative Estimate Update Law for net- 
works of n > 2 agents. Each agent has maintains a local copy of the 
pseudodistance vector and of the interpolation points (which always take 
value in dQ because the boundary is time-invariant). Specifically, for i G 

{l,...,n}, agent i maintains vector V' 1 ' and interpolation points q a , for 
a G {1, ■ • • , Hip}- We define the aggregate pseudodistance vector V as fol- 
lows: we let T> a equal the most recently updated element of the vector 
{T>a , . . . ,T>a }, that is, the pseudodistance between the most recently up- 
dated interpolation points qa and q^ +1 , for i G {1, . . . ,n}. As before, after 
a re-parametrization of time, let £ G N denote the times at which projection- 
and-placements events take place (independently of which agent i executes 
the event) and let nxt(€) G {1, . . . , ni p } denote the index corresponding to 
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the event taking place at time £ (independently of which agent i executes the 
event). Note that when agent i updates the interpolation points q nx t(£)-i 
and 9 n xt(£)-2; agent % then transmits the updated points to its immediately 
following agent i — 1, so that the processor state of agent i — 1 contains 
the correct updated information. Also note that since the boundary is time- 
invariant, the updated interpolation points belong to the trajectory path' 1-1 ' 
that agent i — 1 maintains in its memory: this fact guarantees that agent i — i 
can properly perform the cyclic-balance operation. In summary, equa- 
tion (6.6.2) is the correct model not only for the Single- Robot Estimate 
Update Law but also for the Cooperative Estimate Update Law. 
This concludes the proof of the boundary estimation part of statement (i) 
for n > 2 robots in Theorem 6.12. 

Let us now relax the assumption on the boundary and consider a time- 
varying 1 1— > dQ(t); as before, we first consider the case of a single robot. We 
assume that pseudodistances between interpolation points along the agent 
path curve are computed exactly. By assumption, the boundary dQ varies 
in a continuously differentiable way and slowly in time and, therefore, the 
projection of the interpolation points is well defined and unique. For the 
case of a time-varying boundary, the state trajectory in continuous time 
is a curve of the form T> : R>o — > K n ' p defined as follows. Note that, in 
general, the interpolation points lie outside dQ at almost all times, and 
therefore it makes no sense to define T> a as the pseudodistance from point 
Qa to q a +i along dQ. Rather, we give the following definition: V is the 
vector of pseudodistances computed by the robot along the curve path. As 
a consequence, the state trajectory T> is constant for almost all times and it 
changes only at projection-and-placement events. Specifically, let £ denote 
the time at which a projection-and-placements event takes place with cor- 
responding index nxt(£) 6 {1, . . . , n ip }. At time £, the Single-Robot Es- 
timate Update Law computes new values for the pseudodistances V nxt -2 
and P n xt-i based on the processor state of the agent (i.e., based on the 
interpolation points and the path variable); these values are the new values 
of the state T>. Because the boundary has upper-bounded length uniformly 
in time and because the agent moves at constant speed, an infinite number 
of projection-and-placement events takes place for each interpolation point 
and the duration of time between two consecutive events is uniformly upper 
bounded. Given this fact, we may let £ £ N serve as index for all projection- 
and-placement times. Clearly, if the boundary does not vary with time, then 
the transition T>{£) = A nxt ^T>(£—l) describes the projection-and-placement 
event at instant £. Because, instead, the boundary is time- varying, we model 
the change in V due to the boundary motion by 

V{£) = A nxt(£) (V(£ - 1) + U(£)) , (6.6.3) 

where U(£) £ M raip is a disturbance. By design, U{£) is nonzero only on 
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components (nxt(-£) — 1) and (nxt(£) — 2) of T>. By the assumptions that 
the boundary varies in a continuously different iable way and slowly with 
time, and that its length is upper bounded, we know that U is vanishing in 
the rate of change of the boundary. Finally, define the disagreement vector 
*->d(*)€span{l nip }- L ty 

1 T T>(£) 
d(£) = V{£)- " lp l„ ip . (6.6.4) 

n ip 

From equation (6.6.3) and from the fact that A nxt ^ is doubly stochastic, 
the update law for d is 

d(£) = A nxt{i) d(£-l) + u(£), lei, (6.6.5) 

where u(£)=U(£) - ^-l T n M{£)l nip . 

Equation (6.6.5) is the correct update equation even in the case of n > 2 
robots moving along a time-varying boundary. This fact is a consequence 
of the two- hop separation assumption (see Definition 6.10). Indeed, as ex- 
plained in Remarks 6.11, the inequality nxtl* -1 ! < nxt^ — 2 guarantees 
that each robot can correctly perform each projection-and-placement event. 
Given the sequence £ £ N, define a new sequence 4 £ N, for k £ N, as fol- 
lows: set £\ = 1, assume without loss of generality that agent 1 is the agent 
executing the first projection-and-placement event with index nxt(l), and let 
£k > 2 be the fc-th time when agent 1 performs the projection-and-placement 
event with same index nxt(l). Reasoning about the possible positions of all 
agents at time £k-i and £k, one can see that £k — £k-i < 2n • n- ip . Define 
sequence Ae h £ M ni p xni p, for k £ N, by A(l) = Aixt(i) and 

-4(4) = Aixt(4) ' ' ' Arxt(4-i+2)Aixt(4-i+l)> for k > 2. 

By Exercise El. 17, each matrix A(£k) is doubly stochastic and irreducible, 
because it is the product of doubly stochastic matrices and because the 
union of the undirected graphs associated with the matrices defining A(£k) 
is connected. By definition, equation (6.6.5) becomes, for k £ N, 

4 
d(4) = .4(4)d(4-i) + J2 Au:t(4) • ' ■ ^nxt(m) u W 

£=4-i+l 

= A(4)d(4-l) + 6(4)u st acked(4), (6.6.6) 

where the vector u sta cked(4) contains all vectors u(4-i + 1), • • ■ , u(4) 5 and 
the matrix £>(4) is defined in the trivial corresponding way. 

Define V : M ra ' p — > M>o by V(x) = x T x and adopt this function as a 
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candidate ISS-Lyapunov function for system (6.6.6). We compute 

F(d(4+i)) - V(d(£ k )) = -d(4) T i?(4)d(4) 

+ "stacked (4) backed (4) + 2u^ acked (4)„4(4)d(4), 

where i?(4) = In ip — A(£k) A(£k)- Because A(£k) is doubly stochastic and 
irreducible, we know (from Exercise El. 5) that R{£k) is positive semidefinite 
and that its simple eigenvalue is associated with the eigenvector l n . . 
This fact implies that the quantity —x R(£k)x is strictly negative for all 
x span{l n . p } . To upper bound this quantity by a negative number, we 
let A s be a generic element of the set of all the possible matrices .4(4) ; such 
matrices are the iterated products of at most 2n • nj p matrices of the form 
Aixti where each matrix -A nxt , nx "t £ {1, .. . ,ni P }, appears at least once. 
Define the set of nonzero eigenvalues of A s by 

S s = {A g R | det (\I n . - (AjA s - I n j) = 0} \ {0} 



and define the eigenvalue with smallest magnitude among all matrices by 
r = min s min{|A| | A £ S s }. Note that f > 0, because we are considering a 
finite set of matrices. We can then write 

F(d(4 + 1)) - V{d{£ k )) < -a 3 (||d(4)||) + ^(||u st acked(4)||), 

where a 3 (||d||) = |r||d|| 2 and <7(||u stacked ||) = (= + l)||u sta cked|| 2 - By Def- 
inition 6.15, the system described by (6.6.6) is input-to-state stable. The 
input-to-state stability implies the existence of a positive e, as in the bound- 
ary estimation part of statement (ii) for n > 2 robots in Theorem 6.12. ■ 



6.7 EXERCISES 

E6.1 (Alternative expression of the symmetric difference). Show that the sym- 
metric difference 5 s between two compact bodies C, B CM. 3 can be alternatively 
expressed as 

S s (C,B) = fi{C\B)+ii(B\C). 

Hint: Use the expressions C = (C \ B) U (C n B) and B = (B \C) U (C n B). 

E6.2 (Characterization of critical inscribed polygons for the symmetric dif- 
ference). Prove Lemma 6.4. Also, show that not all critical configurations are 
optimal. Specifically, consider the convex body and the gray inscribed triangle 
depicted in Figure E6.1(a). Show that the gray triangle is a saddle configuration 
for 5 s by establishing that modifications of the triangle as in Figure E6.1(b) de- 
crease its area (and hence increase 8 s ), whereas modifications of the gray triangle 
as in Figure E6.1(c) increase its area (and hence decrease 5 s ). 

E6.3 (The "n-bugs problem" and cyclic interactions: cont'd). Consider n 
robots at counterclockwise-ordered positions 6\ , . . . , 8 n following the cyclic bal- 



271 



"Distributed Control of Robotic Networks" by F. Bullo, J. Cortes and S. Martinez 
Copyright © 2006-2009. Manuscript under contract. This version: March 22, 2009 



DCRN March 22, 2009 






(a) 



(b) 



(c) 



Figure E6.1 An illustration of the fact that polygons satisfying (6.2.1) may not be optimal 
for <5 S . 



ancing system described in Exercise El. 30, with parameter k = 1/4: 
Show that 

dist cc (s,.,(fl,fi^+i)) = jdist cc (ei-i(t),ei(£)) + jdist cc (0 4 (*),0«+i(.Q). 

E6.4 (ISS properties of averaging algorithms with inputs and outputs). This 
is a guided exercise to prove some of the ISS properties of averaging algorithms 
with inputs and outputs. An averaging algorithm with inputs associated to a 
sequence of stochastic matrices {F(£) | i £ Z>o} C K nxn , a sequence of input 
gains {D{tj \ £ € Z> } C R" xfc , and a sequence of disturbances u : Z>o -» K fe is 



the discrete-time dynamical system 

x(£+l) = F(£)x(£) + D{£)u(£), £eZ> . 



(E6.1) 



A natural question to ask is how the evolution of the trajectory x is affected by 
the noise u. Let us address this in the following. Define the matrix 



P = 



1 -1 
1 







p(»-l)x» 



.0 ... 1 -1 
Note that, with the notation of Exercise El. 7, one can write 



P 

1 ,T 



Define the following output for the dynamical system (E6.1) 

031 — 032 \ 



Per 



Px 



\Xn — l «/' 



J 



272 



"Distributed Control of Robotic Networks" by F. Bullo, J. Cortes and S. Martinez 
Copyright © 2006-2009. Manuscript under contract. This version: March 22, 2009 



DCRN March 22, 2009 



This output can be thought of as an error signal that quantifies the disagreement 
among the components of the state. Now, consider the change of variables 

,'lfarr 



ave 



where x ave € M is the average of the components of x. 
Verify that system (E6.1) reads in the new variable z as 

z(£ + 1) = TF^T' 1 z(£) + TD{i)u{i). 

The previous result is a formal statement of the following intuition. Because of 
the definition of z and of the special structure of {F(£) | £ £ Z> }, the variable 
x ave plays no role in the evolution of y e rr- Accordingly, we define the error system 
by 

y err (£ + 1) = F eTT {£)y elI (£) + D elI (£)u(£), (E6.2) 

and the average system by 

x, ve (£ + 1) = ZaveW + c err (£)y err {£) + D, ve (£)u{£), (E6.3) 

for D eTT (£) = PD{£) and D ave (£) = ±1%D(£). 
Assume now that: 

(a) The sequence {F(£) \ £ £ Z> } is a non-degenerate sequence of stochastic 
matrices. 

(b) For £ £ Z>o, let G(£) be the unweighted digraph associated with F(£). 
There exists a duration 5 £ N such that, for all £ £ Z> the digraph 
G{£ + 1) U . . . U G(£ + S) contains a globally reachable node. 

(c) The induced norm of {D(£) \ £ £ Z>o}, for £ £ Z>o, is uniformly bounded. 
Prove that, under assumptions (a), (b) and (c) on the averaging system with 

inputs, the following equivalent statements hold: 

(i) the system (E6.1) with output y evv is IOS; and 
(ii) the error system (E6.2) is ISS. 
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line integral, 114 
linear iteration, see 
algorithm, 
distributed, linear 
Lyapunov function, see 
function, Lyapunov 

map, 2 

composition, 2 

image of, 2 

inverse, 2 

level set of, 2 

overapproximation, 20 

set- valued, 2, 17 
closed, 18 

support of, 2 
Markov chain, 66, 90 
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matrix 
adjacency, see weighted 

digraph, adjacency 

matrix of 
circulant, 8, 84 

tridiagonal, 62 
column-stochastic, 7 
convergence time of, 59 
convergent, 10 
doubly stochastic, 7, 

33, 58, 84 
exponential 

convergence factor of, 

59 
incidence, see weighted 

digraph, incidence 

matrix of 
irreducible, 11, 34 
Laplacian, see weighted 

digraph, Laplacian 

matrix of 
M -, 85 
M-, 85 

nonnegative, 7 
normal, 7 
orthogonal, 6 
permutation, 7 
positive, 7, 34, 35 
primitive, 11, 35, 57 
reducible, 11 
row-stochastic, 7, 33 
semi-convergent, 10 
singular values, 8 
special orthogonal, 6 
spectral radius, 9 

essential, 10 
spectrum, 8 
stochastic, 7, 85, 87, 88 
Toeplitz, 7 

tridiagonal, 62 
tridiagonal 

augmented, 64, 238 
unitarily similar, 9 
unitary, 9 
median point, see 

Fermat- Weber center 
message, 38, 142, 243 
basic, 41 



message-generation 

function, 38, 142, 243 
standard, 39, 144 
message-reception 

function, 243 
message-trigger function, 

243 
method of empirical 
distributions, 248 
metric space, 3 
Metropolis-Hastings 

weights, 87 
minimum- weight 

spanning tree, see 
tree, spanning, 
minimum- weight 
motion control function, 

142, 153, 244 
multicenter function, 
110, 116 
area, see function, area 
disk-covering, see 
function, 
disk-covering 
distortion, see function, 

distortion 
expected- value, 110 
mixed distortion-area, 
see function, mixed 
distortion-area, 132 
sphere-packing, see 
function, 
sphere-packing 
worst-case, 117 

natural immersion, 108 
neighborhood 
of a point, 4 
of a set, 4 
network 
asynchronous, 163 
evolution, 39 
robotic, 138 
asynchronous 
event-driven 
evolution, 246 
event-driven 
asynchronous, 243 



evolution of, 143, 153 
relative-sensing, 151 
uniform, 139 
synchronous, 37, 163 
node 
active, 118, 121 
passive, 118, 121 
non-degenerate sequence 
of stochastic 
matrices, 55 
norm 
LP, 3 
matrix 
p-induced, 9 

open lune, 4 
Overapproximation 

Lemma, 20 
overapproximation 

system, 20 

Parallel Axis Theorem, 

99, 112 
partition, 100 
r-limited Voronoi, 100 
Voronoi, 100, 111, 118, 
121 
performance, 110, 216 
Perron-Frobenius 
theorem 
for irreducible matrices, 

11 
for positive matrices, 

11 
for primitive matrices, 
12 
polar moment of inertia, 

99 
polygon, 94 
diagonal, 95 
edge of, 94 
inscribed, 247, 270 
nonconvex, 95 
perimeter, 95 
simple, 94 
vertex 
exterior angle, 95 
interior angle, 95 
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vertex of, 94 
polytope, 95 
edge, 95 
face, 95 

facet, see polytope, face 
vertex, 95 
problem 
1-center, 111 
n-bugs, 90, 241, 271 
area, 113, 115, 131, 135 
Art Gallery, 233 
BFS tree computation, 

43 
broadcast, 43 
connectivity 

maintenance, 177, 

198 

network, 180 

pairwise, 178 
continuous p-center, 

117 
continuous p-median, 

111 
distortion, 112, 115, 

134 
gathering, see problem, 

rendezvous 
hypothesis testing, 90 
leader election, 46, 163 
mixed distortion-area, 

113, 116 
rendezvous, 176, 197 
shortest-paths tree 

computation, 49 
uncapacited facility 

location, 32 
processor, 12 
allowable initial states 

of, 153 
allowable initial values, 

38, 142, 243 
state, 38, 143 

set, 38, 142, 153, 243 
projection, 5 
proximity graph, 102, 

123, 139 
r-oo-disk, 104 
r-disk, 103 



r-limited Delaunay, 103 
complete, 102 
Delaunay, 103 
edge map of, 102 
Euclidean minimum 

spanning tree of, 104 
Gabriel, 104 
locally cliqueless graph 

of, 108, 133 
range-limited visibility, 

104 
relative neighborhood, 

103 
sensing, 152 
set of neighbors map 

of, 105 
spatially distributed 

graph over, 106 
spatially distributed 

map over, 109, 116 
subgraph of, 105 
visibility, 104 

reference frame, 148 
body, 148 
fixed, 148 
relative-sensing control 

law, 153 
equivalent, see control 

and communication 

law, equivalent 
static, 153 
ring digraph, see 

digraph, ring 
robot, 137 
allowable initial states 

of, 137 
anonymous, 145 
control vector field of, 

137 
differential drive, 138 
Dubins, 138 
input of, 137 
input space of, 137 
mobile, 137 
oblivious, 145 
physical state of, 137 
Reeds-Shepp, 138 



state space of, 137 
with relative sensor, 
149 

segment 
closed, 94 
open, 94 
sensor 
disk, 151 
footprint, 151 
visibility, 151 
set 
s-partition of, 160 
boundary of, 1, 252 
connectivity constraint, 

180 

Q-, 182 

line-of-sight, 185 

locally cliqueless 
line-of-sight, 186 

pairwise, 178 

pairwise line-of-sight, 
185 
contraction of, 95, 182 
convex, 7, 94 
globally asymptotically 

stable, 15 

uniformly, 19 
globally attractive, 15 

uniformly, 19 
interior of, 1 
kernel, 95 
locally asymptotically 

stable, 14 

uniformly, 19 
locally attractive, 14, 

19 

uniformly, 19 
path connected, 5 
positively invariant, 14 

strongly, 18 

weakly, 18 
relative perimeter of, 97 
relatively convex, 96 
simply connected, 5 
stable, 14 

uniformly, 19 
star-shaped, 95 
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strict concavity of, 95 
strictly concave point 

of, 95 
unstable, 14 
visibility, 95 
range-limited, 95 
sink, see digraph, sink of 
source, see digraph, 

source of 
stability, 14 
global asymptotic, 15 

uniform, 19 
input-to-state, 265, 271 
local asymptotic, 14 

uniform, 19 
uniform, 19 
state machine, 12 
allowable initial states 

of, 12 
evolution map of, 12 
evolution of, 12 
input space of, 12 
state space of, 12 
state-transition function, 

38, 142, 153, 244 
state-transition trigger 

function, 244 
subgraph, see digraph, 

subgraph of 
symmetric difference, 

247, 270 
synchronization, 68 

tangent space, 2 
task, see coordination 

task 
token, 43 
topology control, 164 



traveling salesperson 

tour, 32 
tree, 22 
breadth-first spanning, 

27, 43 
child in, 23 

depth-first spanning, 29 
directed, 23 

depth of, 26 

spanning, see tree, 
spanning 
parent in, 23 
root of, 23 
rooted, see tree, 

directed 
shortest-paths, 30 
siblings in, 23 
spanning, 23 

minimum- "weight, 32 
vertex 

predecessor of, 23 

successor of, 23 

unicycle, 138, 219 
unique identifier, 37, 138 
unstability, 14 

vector field 
control-affine, 13 
driftless, 13 
time-dependent, 13 
versor, 235 
vertex, see digraph, 
vertex and graph, 
vertex 
Vicsek's model, see 

algorithm, averaging, 
adj acency-based 
visible, 95 



Voronoi configuration 
?'-limited centroidal, 

101, 216 
centroidal, 101, 216 
circumcenter, 101, 217 
incenter, 101, 217 
Voronoi partition, see 
partition, Voronoi, 
123 

weighted digraph, 25 
adjacency matrix of, 

25, 33 

unweighted, 25 
in-degree matrix of, 26 
incidence matrix of, 86 
Laplacian matrix of, 

36, 88 
out-degree matrix of, 

26 
shortest-paths tree of, 

see tree, 

shortest-paths 
undirected, 25 
unweighted version of, 

25 
vertex 

in-degree, 26 

out-degree, 26 
weight-balanced, 26, 

33, 88 
weighted depth, 27 
weighted diameter, 27 
weighted distance, 27, 

32 
weighted radius, 27 

Zeno behavior, 246 
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Symbol Index 



Tare 

0(g) 

tola) 
©G?) 

dS 
\S\ 
Si xS 2 

TlacA So, 

s n 

S s 
6 s 



GC\G' 
GuG' 

G{S) 

Hp,q 

H s (v) 

[a,b] 

]a,b[ 

f:S- 

f°9 

r 1 



r 



h: S- 
A>0 
A> 



^>o 



T 



arc-length parametrization, 5 

big O Bachmann-Landau symbol, 3 

big Omega Bachmann-Landau symbol, 3 

big Theta Bachmann-Landau symbol, 3 

boundary of the set S, 1 

number of elements of the finite set S, 1 

Cartesian product of S± and 52, 2 

Cartesian product of the collection of sets {S a } ae A, 2 

Cartesian product of n copies of S, 2 

^-contraction of S, 95 

symmetric difference, 247 

density function on M. d , 99 

the empty set, 1 

intersection of graphs G and G' , 21 

union of graphs G and G' ,21 

set of all undirected graphs whose vertex set is an element 

of F(5), 102 

closed halfspace defined by p and q, 94 

internal tangent halfplane of v with respect to S, 96 

closed interval between the numbers a and b, 2 

open interval between the numbers a and b, 2 

map / from set S to set T, 2 

composition of the maps / and g, 2 

inverse map of a function /, 2 

level set of a function / corresponding to a value x, 2 

overapproximation map associated to a time-dependent 

evolution /, 20 

set- valued map h from set S to set T, 2 

a symmetric positive definite matrix A, 6 

a symmetric positive semidefinite matrix A, 6 
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A T 
U* 

yH : Z> 

'Lniax 

Hz 

'texp 

" area, a 

'Ldist-area,a,b 

'Ldist-area,a 

I* worst 

^dc 

^sp 

S 

S 

s F 

^disk 

'-'oo-disk 
'-'vehicles 

'-'vis-disk 

'-'circle 
crs 
°disk 



Crs 
vis- disk 



II 411 

Vi 

f-(a) 



A n 



transpose of a real matrix A, 6 
conjugate transpose of a complex matrix [/, 6 
trajectory describing the messages received by processor 
i, 39 

/c-center function, 32 
^-median function, 32 
expected- value multicenter function, 110 
distortion function, 112 
area function, 113 
mixed distortion-area function, 113 
mixed distortion- area function with b = —a 2 , 113 
worst-case multicenter function, 117 
disk-covering multicenter function, 118 
sphere-packing multicenter function, 120 
network, 37 
robotic network, 138 
network associated to F £ M. nxn , 53 
network of first-order robots with range-limited commu- 
nication, 139 

network of first-order robots with Delaunay communica- 
tion, 140 

network of first-order robots with range-limited Delau- 
nay communication, 140 

network of first-order robots with r-oo-disk communica- 
tion, 140 

network of planar vehicle robots with Delaunay commu- 
nication, 140 

network of robots with line-of-sight communication, 140 
network of first-order robots in S 1 , 141 
network of first-order robots with range-limited relative 
sensing, 151 

network of robots with line-of-sight relative sensing, 152 
L p -norm of a vector x, 3 
p-induced norm of a matrix A, 9 
s-partition of I, 160 
limit from the left of / at a, 114 
limit from the right of / at a, 114 

polar moment of inertia of S about p with respect to (ft, 
99 
state of processor i, 38 
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r exp\A) 

E b 

y fixed 

}p,q[ 

rbt-sns : 



initial state of processor i, 39 

state set of processor i, 38 

set of allowable initial values for processor i, 38 

exponential convergence factor of A 6 M nxn , 59 

body reference frame, 148 

fixed reference frame, 148 

closed segment with extreme points p and q, 94 

open segment with extreme points p and q, 94 



R d -> A 



rbt 



env-sns : 1T\ 1KT J 

{SafaGA 

xeS 
Re S 
RCS 

^aGA S a 

5iU5 2 

UagA S a 

u 
ld- 

*dfck(p W ,P M ) 

*d«k(p [,1 ,P) : 

^disk,e(p H ,P) : 

^vis-disk (p w ,P b1 ;Q 



sensing function, 150 

A 

environment sensing function, 150 

collection of sets indexed by the index set A, 2 

x is an element of the set 5, 1 

R is a subset of 5, 1 

R is a strict subset of 5, 1 

intersection of sets S\ and S 2 , 2 

intersection product of the collection of sets {S a } a ^A, 2 

union of sets Si and S 2 , 2 

union of the collection of sets {S a }a£A, 2 

the vector in R d whose entries are zero except for the ith 

entry, which is one, 2 

the vector in M. d whose entries are all equal to one, 2 



shorthand for (1, — 1, 1, ... , ( — 1) 



d-2 



-1 



,d-lN 



\ 65 



the vector in R whose entries are all equal to zero, 2 

pairwise connectivity constraint set of agent at p'-' 1 ' with 

respect to agent at pv>, 178 

connectivity constraint set of agent at p*- 1 ' with respect 

to V, 180 

^-connectivity constraint set of agent at p^ with respect 

to V, 182 



line-of-sight connectivity constraint set in Qs of agent at 
pW with respect to agent at p^' , 185 

Xvis-disk(p®, V;Qs) ■ 

line-of-sight connectivity constraint set in Qs of agent at 
pM with respect to V, 185 

^lc-vis-disk(p W ,^;Q«5) : 

locally cliqueless line-of-sight connectivity constraint set 
in Q$ of agent at p™ with respect to V, 186 
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communication alphabet, 38 
sensing alphabet, 150 
environment sensing alphabet, 150 
area of S with respect to 4>, 99 
average of points in S, 177 
adjacency matrix of G, 25 
augmented tridiagonal matrix, 64 
open ball of center x and radius s, 4 
closed ball of center x and radius e, 4 
centroid or center of mass of S with respect to (f>, 99 
circumcenter of S, 97 
circumradius of S, 97 

communication complexity of a distributed algorithm T>A , 
41 

mean communication complexity to achieve T, 158 
mean communication complexity to achieve Twith CC, 
158 
MCC(T,CC,x ,w ) : 

mean communication complexity to achieve T with CC 
from {xq,wq), 158 

IH-MCC(CC,ai ,u;o) : 

infinite-horizon mean communication complexity, 159 

total communication complexity to achieve T, 158 
total communication complexity to achieve Twith CC, 
158 



^rbt 

A 

MS) 

avrg(S*) 

A{G) ' 

ATrid±(a,6) 

B(x,e) 

B(x,e) 

CM^S) 

CC{S) 

CR(5) 

CC(VA) 

MCC(T) 
MCC{T, CC) 



TCC(T) 
TCC(T,CC) 



TCC(T, CC,x ,w ) 



L-L- AGREE &z PURSUE 
CC AVERAGING 
L-^CRCMCNTR 

CC 



-PLL-CRCMCNTR 



total communication complexity to achieve T with CC 

from (xo,Wq), 158 

agree and pursue control and communication law, 146 

averaging control and communication law, 187 

circumcenter control and communication law, 189 

parallel circumcenter control and communication law, 

192 

NONCONVEX CRCMCNTR : 

circumcenter control and communication law in noncon- 
vex environments, 195 

CCvrn-cntrd : Voronoi-centroid control and communication law, 218 

L^Vrn-cntrd-dynmcs : 

Voronoi-centroid control and communication law on pla- 
nar vehicles, 219 

CCvrn-crcmcntr : Voronoi-circumcenter control and communication law, 



CC, 



221 
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L^Vrn-ncntr 
CL. Lmtd-Vrn-nrml 



cc 



Lmtd-Vrn-cntrd 



cc 



Rng-Vrn-cntrd 



cc 

ctl 
co(5) 

K abs 
^signed 



Circ n (a, b, c) 

D in (G) 

D out (G) 

d- m (v) 

d ut(v) 

diag(S n ) 

diag(u) 

diam(,S') 
diam(G) 
Dscn(/) 
dist 

"curvature \ Qi ; Qj ) 
£>arc (<&,<?;) 

dist c 
dist cc 
dist g 
distp 

distc 

wdistc 

VA 

£g 
E(G) 



Voronoi-incenter control and communication law, 222 
limited- Voronoi-normal control and communication law, 
223 

limited- Voronoi-centroid control and communication law, 
224 

range-limited version of Voronoi-centroid control and com- 
munication law, 225 
control and communication law, 142 
■Pj-rescheduling of CC, 161 
motion control function, 142 
convex hull of S, 94 
absolute curvature, 6 
signed curvature, 6 
set of complex numbers, 2 
set ofnxm complex matrices, 6 
tridiagonal circulant matrix, 62 
weighted in-degree matrix of G, 26 
weighted out-degree matrix of G, 26 
weighted in-degree of a vertex v, 26 
weighted out-degree of a vertex v, 26 
diagonal set of the Cartesian product S n , 2 
square matrix with components of vector v in the diago- 
nal, 6 

diameter of the set S, 5 
diameter of G, 26 

set of points where / is discontinuous, 114 
distance function, 3, 4 
curvature distance between qi and qj, 249 
arc- length distance between qi and qj, 249 
clockwise distance, 3 
counterclockwise distance, 3 
geodesic distance, 3 
L p -distance, 3 

pseudo-distance between qi and qj, 250 
distance in G, 26 
weighted distance in G, 27 
distributed algorithm, 38 
edge map associated to Q, 102 
edges of G, 20 
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-C'cmm 

Ed(Q) 

£CC 

Fa(Q) 

¥(S) 

fti 

G 

G 

Gd 

GeMST,G 

Gemst 

Gg 

Gic,g 

Grn 

»cmplt 

£diskO) 

<?oo-disk(j) 

£ldO) 

Gvis,Q 
^vis-disk, Q 

ids 
In 

image(/) 

i ¥ : X n -► 
IC(5) 

1r 
IR(S) 

int(S) 

I 

kernel(S') 

kernel(A) 

L(G) 

C f V 

msg-gen 

msg-rec 

msg-trig 

msg 



¥(X) 



set of communication links in a network of processors or 

in a robotic network, 37 

edges of Q, 95 

event-driven control and communication law, 243 

faces of Q, 95 

collection of finite subsets of the set S, 1 

from-to-inside function, 94 

a graph or a digraph, 20 

proximity graph, 102 

Delaunay graph, 103 

Euclidean minimum spanning tree of G, 104 

Euclidean minimum spanning tree of the complete graph, 

104 

Gabriel graph, 104 

locally cliqueless graph of G, 108 

relative neighborhood graph, 103 

complete proximity graph, 102 

r-disk graph, 103 

r-co-disk graph, 104 

r-limited Delaunay graph, 103 

visibility graph in Q, 104 

range- limited visibility graph in Q, 104 

identity map on a set 5, 2 

n x n identity matrix, 6 

image of the map /, 2 

natural immersion of X n into ¥(X), 108 

incenter of 5, 98 

indicator map associated with a set R, 2 

inradius of S, 98 

interior of the set S, 1 

set of unique identifiers, 37 

visibility kernel set of S, 95 

kernel subspace of a matrix A, 6 

Laplacian matrix of G, 36 

Lie derivative of a function V along a vector field /, 16 

message-generation function, 243 

message-reception function, 243 

message-trigger function, 243 

message-generation function, 38 
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M(z,w) 
MST 

Ng at (v) 

Mg 
null 

N 

n out 

PCC(S) 

V(S) 

PTOJvk 

Tronxm 



radius(i>, G) 

P 

rank(A) 

rco(S;X) 

K 

SC{VA) 

SC(T,CC) 

P{A) 

Pess(A) 

spec(^4) 

S d 
stf 
stf-trig 

Te(A) 



T§ d 
T 

-'e-sp-dply 

-'e-bndry 

-'e-eqdstnc 

"?dir 

-'e-eqdstnc 



set of all non-null messages generated during one com- 
munication round from (x,w), 158 
minimum-weight spanning tree, 32 
set of neighbors of v in G, 21 
set of in-neighbors of v in G, 21 
set of out-neighbors of v in G, 21 
set of neighbors map of Q, 105 
null message, 38 
set of natural numbers, 2 
outward normal vector, 6 
parallel circumcenter of S, 192 
collection of subsets of the set S, 1 
projection onto the set W, 5 
set ofnxm real matrices, 6 
set of real numbers, 2 
set of non- negative real numbers, 2 
set of positive real numbers, 2 
radius of v in G, 26 
radius of curvature, 6 
rank of a matrix A, 6 
relative convex hull of S in X, 97 
set of mobile robots, 138 

space complexity of a distributed algorithm T>A, 41 
space complexity to achieve Twith CC, 158 
spectral radius of a matrix A, 9 
essential spectral radius of a matrix A, 10 
spectrum of a matrix A, 8 
sphere of dimension d, 2 
state-transition function, 38 
state-transition trigger function, 244 
e-convergence time of A £ M. nxn , 59 
tangent space of Mr, 2 
tangent space of § d , 2 
coordination task, 155 
e-sphere-packing deployment task, 217 
boundary estimation task, 251 
agent equidistance task, 251 
direction agreement task, 156 
equidistance task, 156 
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-'rndzvs 

-'e-rndzvs 

-'e-distor-dply 

-'e-r-area-dply 

J- £-r-distor-area-dply 

-* e-dc-dply 

TC(2M) 
TC(7) 

tc(t,cc) 
tc(t,cc,x ,w ) 

TSP 
2bfs 
3dfs 

-* shortest-paths 

Trid n (a,6, c) 
vers : M d -> M d 
K(G) 
Ve(Q) 
Vi(p;5) 
Vi d isk(p; 5") 

V(7>) 



rendezvous task, 177 

e-rendezvous task, 177 

e-distortion deployment task, 216 

e-r-area deployment task, 216 

e-r-distortion-area deployment task, 216 

e-disk-covering deployment task, 217 

time complexity of a distributed algorithm VA, 41 

time complexity to achieve T, 157 

time complexity to achieve Twith CC, 157 

time complexity to achieve Twith CC from (xq,wq), 157 

traveling salesperson tour, 32 

breadth-first spanning (BFS) tree, 27 

depth-first spanning (DFS) tree, 29 

shortest-paths tree, 30 

tridiagonal Toeplitz matrix, 62 

versor operator, 235 

vertices of G, 20 

vertices of Q, 95 

set of all points in S visible from p, 95 

set of all points in S within a distance r and visible from 

p, 95 

Voronoi cell of pi, 100 

r-limited Voronoi cell of pi, 100 



Voronoi partition generated by V = {pi, . . . ,p n }, 

r-limited Voronoi partition generated by V = {p\ , 

100 

set of non- negative integer numbers, 2 



100 



,Pn}, 
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